-- Logs begin at Thu 2022-07-28 08:29:10 UTC, end at Thu 2022-07-28 09:36:47 UTC. -- Jul 28 09:02:32.578623 dv-cinder-851249-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 09:02:32.587371 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 09:02:32 2022] *** Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: nodename: dv-cinder-851249-5-iscsi Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: machine: x86_64 Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: clock source: unix Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: pcre jit disabled Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: detected number of CPU cores: 4 Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: current working directory: / Jul 28 09:02:32.589586 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: detected binary path: /usr/bin/uwsgi-core Jul 28 09:02:32.590263 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: your processes number limit is 47680 Jul 28 09:02:32.590263 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: your memory page size is 4096 bytes Jul 28 09:02:32.590263 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: detected max file descriptor number: 2048 Jul 28 09:02:32.590263 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: lock engine: pthread robust mutexes Jul 28 09:02:32.590263 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: thunder lock: enabled Jul 28 09:02:32.590263 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 09:02:32.590263 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 09:02:32.628907 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: Python main interpreter initialized at 0x562f320b89c0 Jul 28 09:02:32.628907 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: python threads support enabled Jul 28 09:02:32.628907 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: your server socket listen backlog is limited to 100 connections Jul 28 09:02:32.628907 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: your mercy for graceful operations on workers is 90 seconds Jul 28 09:02:32.629281 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 09:02:32.629346 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: *** Operational MODE: preforking *** Jul 28 09:02:32.629609 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: *** uWSGI is running in multiple interpreter mode *** Jul 28 09:02:32.629609 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: spawned uWSGI master process (pid: 103338) Jul 28 09:02:32.629859 dv-cinder-851249-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 09:02:32.630507 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: spawned uWSGI worker 1 (pid: 103339, cores: 1) Jul 28 09:02:32.633313 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: spawned uWSGI worker 2 (pid: 103340, cores: 1) Jul 28 09:02:32.633313 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 09:02:33.290986 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 09:02:33.293517 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 09:02:34.378716 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:02:34.378716 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: from cryptography.utils import int_from_bytes Jul 28 09:02:34.379302 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:02:34.379302 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: from cryptography.utils import int_from_bytes Jul 28 09:02:34.384600 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:02:34.384600 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: from cryptography.utils import int_from_bytes Jul 28 09:02:34.385027 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:02:34.385027 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: from cryptography.utils import int_from_bytes Jul 28 09:02:36.905357 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:02:36.905991 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:02:36.906158 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:02:36.906531 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:02:36.906789 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:02:36.907182 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.907515 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.907784 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:02:36.908167 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.908281 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:02:36.908378 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.908467 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.908550 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:02:36.908770 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.908917 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:02:36.909095 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.909186 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:02:36.909419 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.909551 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.909756 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.909901 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.910061 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.910228 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.910382 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.910549 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.910713 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-5-iscsi {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.910882 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.911041 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.911194 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.911352 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.911573 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.911704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.911832 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.911975 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.912142 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.912274 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.912412 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.912594 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.912724 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.912920 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.913050 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-5-iscsi {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.913336 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.913465 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.913649 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.913869 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.913998 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.914186 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.914310 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.914501 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.914622 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.914841 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.914973 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.915160 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.915276 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.915473 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.915694 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.915918 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.916067 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.916296 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.916484 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.916681 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.916873 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.917069 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.917271 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.917456 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-5-iscsi {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.917710 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.917957 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.918170 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.918407 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.918601 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.918786 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.918977 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.919166 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.919461 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.919617 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.920019 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.920145 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.920275 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-5-iscsi {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.920433 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.921011 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.921160 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.921279 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.921390 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.921499 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.921608 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.921717 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.921941 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.922061 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.922301 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.922470 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.922587 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.922697 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.922809 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.922922 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923032 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923135 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923242 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923345 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923462 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923590 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923703 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923849 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.923970 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.924075 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.924187 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.924310 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.924461 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.924575 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.924694 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.924805 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.924957 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.925104 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.925260 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.925374 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.925476 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.925592 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.925704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.925808 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.928218 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.928938 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.929086 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.929223 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.929347 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.929484 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.929607 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.929741 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.929882 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.930024 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.930153 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.930282 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.930404 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.930538 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.930660 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.930787 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.930914 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.931041 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.931175 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.931322 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.931454 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.931581 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.931701 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.931827 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.931959 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.932087 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.932213 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.932335 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.932335 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.932558 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.932691 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.932812 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.932938 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.933058 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.933188 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.933318 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.933451 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.933573 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.933699 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.933819 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.934006 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.934139 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.934139 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.934367 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.934367 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.934602 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.934807 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.935199 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.935322 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.935450 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.935576 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.935696 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.935821 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.935953 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.936079 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.936205 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.936332 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.936451 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.936451 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.936695 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.936825 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.936946 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.937065 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.937190 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.937316 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.937490 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.937615 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.937774 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.937928 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.938060 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.938192 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.938315 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.938435 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.938554 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.938674 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.938793 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.938995 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.939119 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.939238 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.939364 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.939485 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.939623 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.939761 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.939889 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940010 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940130 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940257 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940384 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940513 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940634 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940761 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940884 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.940884 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.941128 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.941256 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.941376 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.941506 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.941626 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.941757 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.941922 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.942047 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.942175 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.942308 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.942435 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.942556 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.942691 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.942820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.942941 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943044 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943156 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943259 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943370 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943474 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943577 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943688 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943792 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.943905 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944036 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944142 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944243 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944345 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944470 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944592 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944724 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944855 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.944977 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.945097 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.945216 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.945335 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.945468 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.945589 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.945708 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.945834 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.945970 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.946084 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.946196 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.946300 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.946403 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.946505 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.946703 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.946842 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.947014 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.947139 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.947323 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.947454 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.947635 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.947767 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.947941 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.948068 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.948326 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.948461 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.948598 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.948727 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.948850 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.948970 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.949687 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.949822 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.950022 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.950162 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.950351 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.950480 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.950679 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.950801 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.950997 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.951122 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.951311 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.951435 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.951622 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.951745 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.951948 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:02:36.952072 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.952294 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.952418 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.952629 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.952751 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.952947 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.953088 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.953268 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.953399 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.953602 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.953732 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.953946 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.954088 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.954267 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.954393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.954582 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.954712 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.954902 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.955039 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.955220 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.955343 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.955537 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.955706 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.955847 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.956032 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.956177 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.956357 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.956483 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.956685 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.956810 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.957006 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.957137 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.957329 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.957459 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.957666 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.957791 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.958028 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.958161 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.958460 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.958602 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.958802 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.958929 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.959049 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.959176 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.959304 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.959425 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.959592 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.959718 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.959939 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.960074 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.960254 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.960390 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.960576 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.960701 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.960893 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.961016 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.961215 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.961345 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.961529 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.961661 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.961903 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.962032 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.962183 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.962321 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.962497 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.962621 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.962813 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.962938 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.963129 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.963267 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.963474 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.963602 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.963761 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.964022 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.964155 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.964424 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.964549 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.964775 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.965443 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.965729 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.965887 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.966104 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.966228 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.966424 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.966548 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.966741 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.966874 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.967060 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.967183 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.967373 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.967496 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.967684 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.967818 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.967996 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.968120 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.968311 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.968426 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.968690 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.968824 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.968946 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.969066 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.969220 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.969344 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.969532 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.969656 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.969861 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.970000 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.970180 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.970305 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.970499 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.970626 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.970815 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.970948 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.971124 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.971248 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.971431 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.971556 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.971750 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.971882 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.972061 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.972185 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.972369 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.972480 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.972679 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.972803 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.972991 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.973128 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.973300 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.973423 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.973612 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.973740 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.973949 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.974087 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.974262 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.974397 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.974578 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.974708 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.974891 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.975025 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.975206 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.975322 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.975516 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.975639 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.975824 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.975957 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.976144 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.976268 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.976460 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.976596 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.976774 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.976909 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.977090 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.977214 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.977406 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.977532 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.977729 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.977902 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.978069 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.978195 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.978386 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.978513 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.978775 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.978903 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.979032 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.979161 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.979288 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.979426 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.979596 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.979721 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.979907 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.980030 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.980289 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.980438 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.980628 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.980753 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.980943 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.981067 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.981254 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.981391 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.981565 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.981689 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.981896 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.982025 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.982209 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.982349 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.982519 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.982671 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.982825 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.982949 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.983133 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.983266 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.983438 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.983557 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.983744 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.983866 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.984075 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.984200 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.984385 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.984514 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.984693 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.984816 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.985002 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.985125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.985311 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.985444 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.985659 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.985784 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.985995 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.986128 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.986321 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.986450 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.986637 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.986770 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.986953 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.987089 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.987269 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.987401 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.987588 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.987719 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.987914 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.988051 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.988227 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.988357 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.988545 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.988760 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.989032 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.989155 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.989275 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.989403 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.989525 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.989659 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.989782 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.989949 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.990113 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.990261 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.990430 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.990588 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.990761 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.990935 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.991062 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.991277 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.991409 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.991599 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.991723 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.991928 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.992052 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.992247 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.992381 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.992568 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.992692 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.992883 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.993015 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.993201 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.993338 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.993518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.993645 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.993917 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.994045 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.994167 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.994306 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.994490 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.994623 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.994804 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.994927 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.995118 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.995255 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.995439 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.995561 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.995754 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.995884 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.996605 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.996737 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.996918 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.997054 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.997240 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.997368 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.997554 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.997678 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.997901 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.998030 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.998222 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.998345 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.998538 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.998662 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.998870 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.999142 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.999267 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.999395 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.999535 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.999657 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.999778 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:36.999905 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.000093 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.000261 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.000392 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.000516 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.000701 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.000827 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.001024 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.001159 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.001335 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.001460 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.001649 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.001779 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.001976 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.002117 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.002287 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.002413 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.002598 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.002723 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.002905 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.003039 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.003213 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.003345 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.003528 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.003664 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.003840 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.003971 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.004152 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.004283 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.004460 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.004592 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.004773 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.004902 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.005082 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.005205 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.005394 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.005519 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.005718 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.005866 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.006059 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.006195 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.006367 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.006489 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.006676 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.006886 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.007014 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.007144 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.007301 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.007434 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.007612 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.007737 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.007920 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.008051 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.008232 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.008371 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.008555 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.008687 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.008871 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.008996 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.009251 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.009389 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.009548 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.009698 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.009825 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.009976 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.010109 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.010239 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.010427 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.010547 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.010743 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.010869 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.011057 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.011183 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.011376 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.011501 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.011747 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.011873 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.012066 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.012681 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.012874 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.012998 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.013188 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.013312 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.013501 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.013625 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.013815 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.013986 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.014152 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.014277 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.014502 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.014650 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.014773 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.014925 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.015092 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.015376 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.015519 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.015707 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.015832 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.016026 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.016149 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.016351 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.016666 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.016791 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.016988 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.017112 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.017318 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.017454 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.017646 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.017770 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.017998 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.018168 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.018381 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.018526 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.018667 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.018790 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.018974 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.019096 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.019365 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.019504 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.019634 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.019764 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.019923 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.020058 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.020238 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.020368 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.020549 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.020682 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.020868 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.020992 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.021181 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.021311 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.021491 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.021626 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.021797 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.021939 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.022135 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.022259 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.022446 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.022570 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.022754 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.022875 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.023062 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.023197 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.023370 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.023493 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.023688 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.023810 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.024000 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.024124 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.024310 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.024439 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.024618 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.024747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.024924 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.025047 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.025250 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.025374 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.025562 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.025694 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.025924 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.026089 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.026252 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.026380 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.026539 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.026700 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.026850 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.027046 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.027175 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.027331 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.027541 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.027710 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.027835 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.028021 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.028152 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.028291 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.028453 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.028596 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.028773 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.028914 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.029091 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.029216 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.029486 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.029620 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.029784 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.029935 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.030073 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.030202 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.030324 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.030465 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.030619 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.030794 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.030930 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.031111 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.031236 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.031434 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.031573 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.031746 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.031878 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.032071 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.032196 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.032390 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.032524 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.032703 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.032828 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.033016 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.033140 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.033329 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.033454 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.033641 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.033765 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.033976 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.034103 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.034295 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.034428 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.034604 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.034734 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.034912 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.035035 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.035227 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.035360 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.035537 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.035661 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.035850 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.035974 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.036159 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.036282 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.036471 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.036596 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.036780 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.036912 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.037092 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.037217 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.037406 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.037582 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.037714 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.037865 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.038042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.038168 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.038359 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.038493 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.038667 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.038798 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.038973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.039103 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.039283 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.039407 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.039661 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.039794 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.039916 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.040036 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.040185 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.040309 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.040514 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.040636 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.040828 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.040952 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.041135 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.041271 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.041443 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.041566 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.041749 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.041956 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.042082 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.042201 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.042376 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.042501 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.042682 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.042805 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.043014 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.043136 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.043335 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.043465 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.043614 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.043735 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.043922 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.044054 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.044229 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.044353 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.044538 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.044660 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.044848 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.044980 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.045153 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.045276 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.045462 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.045587 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.045771 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.045946 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.046146 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.046271 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.046456 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.046580 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.046797 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.046933 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.047116 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.047246 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.047434 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.047563 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.047752 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.047882 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.048063 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.048187 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.048382 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.048511 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.048696 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.048820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.049002 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.049125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.049323 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.049448 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.049711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.049973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.050102 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.050215 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.050322 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.050539 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.050662 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.050860 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.050980 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.051185 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.051295 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.051501 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.051636 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.051829 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.051955 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.052140 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.052264 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.052457 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.052593 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.052766 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.052890 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.053078 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.053201 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.053391 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.053514 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.053702 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.053826 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.054038 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.054162 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.054354 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.054481 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.054668 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.054799 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.054981 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.055112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.055294 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.055419 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.055607 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.055730 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.055919 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.056057 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.056226 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.056360 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.056533 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.056664 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.056842 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.056978 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.057150 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.057282 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.057461 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.057584 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.057775 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.057939 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.058109 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.058242 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.058423 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.059080 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.059269 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.059406 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.059586 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.059742 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.060215 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.060341 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.060572 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.060704 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.060886 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.061017 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.061199 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.061322 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.061510 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.061635 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.061825 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.061968 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.062167 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.062292 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.062476 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.062601 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.062796 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.062918 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.063105 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.063230 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.063506 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.063662 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.063824 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.063950 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.064136 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.064267 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.064443 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.064567 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.064750 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.064872 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.065062 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.065196 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.065374 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.065498 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.065683 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.065808 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.066018 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.066155 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.066326 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.066451 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.066635 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.066760 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.066959 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.067091 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.067266 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.067397 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.067592 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.067717 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.067978 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.068102 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.068310 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.068441 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.068620 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.068746 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.068999 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.069123 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.069327 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.069470 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.069651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.069775 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.070004 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.070126 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.070321 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.070446 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.070648 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.070797 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.070959 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.071085 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.071280 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.071406 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.071595 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.071721 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.071925 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.072049 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.072255 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.072381 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.072573 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.072699 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.072893 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.073030 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.073204 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.073336 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.073525 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.073657 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.073889 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.074031 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.074731 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.074864 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.075088 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.075281 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.075481 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.075663 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.075788 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.075909 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.076110 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.076233 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.076419 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.076586 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.076712 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.076833 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.077032 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.077159 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.077344 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.077478 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.077654 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.077778 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.077989 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.078119 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.078304 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.078439 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.078618 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.078749 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.078937 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.079063 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.079251 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.079376 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.079560 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.079684 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.079869 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.079992 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.080180 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.080321 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.080514 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.080639 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.080854 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.080984 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.081114 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.081236 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.081411 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.081537 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.081729 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.081918 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.082069 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.082213 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.082394 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.082582 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.082735 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.082892 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.083036 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.083178 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.083321 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.083463 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.083607 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.083797 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.083948 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.084100 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.084243 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.084393 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.084585 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.084729 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.084870 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.085013 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.085155 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.085304 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.085457 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.085599 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.085777 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.085951 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.086119 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.086274 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.086460 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.086606 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.086794 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.086947 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.087120 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.087264 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.087446 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.087591 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.087769 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.087913 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.088062 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.088211 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.088358 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.088503 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.088791 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.088936 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.089088 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.089245 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.089388 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.089538 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.089682 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.089917 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.090066 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.090223 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.090397 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.090632 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.090632 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.090869 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.091000 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.091137 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.091258 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.091378 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.091506 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.091626 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.091821 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.091944 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.092064 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.092197 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.092323 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.092477 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.092644 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.092819 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.092948 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.093157 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.093281 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.093638 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.093781 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.093964 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.094304 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.094428 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.094622 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.094944 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.095088 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.095269 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.095550 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.095679 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.095893 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.096118 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.096235 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.096524 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.096754 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.096883 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.097153 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.097352 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.097492 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.097782 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.097975 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.098210 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.098449 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.098676 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.099170 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.099396 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.099520 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.099641 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.099789 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.099957 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.100087 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.100286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.100429 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.100555 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.100956 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.101201 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.101378 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.101522 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.101666 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.101914 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.102082 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.102241 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.102241 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.102539 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.102696 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.102845 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.103002 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.103151 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.103300 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.103570 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.103750 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.103978 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.104164 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.104322 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.104471 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.104627 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.104778 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.104935 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.105109 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.105276 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.105461 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.105619 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.105777 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.106002 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.106146 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.106300 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.106444 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.106595 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.106747 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.106891 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.107046 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.107204 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.107355 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.107500 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.107650 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.107792 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.107942 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.108085 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.108227 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.108383 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.108528 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.108673 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.108840 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.108983 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.109139 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.109388 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.109542 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.109687 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.109834 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.110032 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.110179 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.110341 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.110487 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.110657 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.110828 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.111009 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.111190 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.111339 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.111487 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.111634 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.111790 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.111946 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.112102 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.112257 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.112406 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.112553 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.112701 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.112887 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.113046 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.113200 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.113347 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.113524 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.113673 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.113898 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.114061 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.114206 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.114354 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.114512 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.114656 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.114814 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.114966 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.115108 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.115251 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.115399 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.115542 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.115693 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.115999 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.116143 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.116300 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.116444 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.116619 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.116776 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.116928 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.117079 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.117322 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.117466 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.117647 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.117800 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.118000 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.118159 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.118316 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.118468 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.118621 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.118765 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.118913 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.119058 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.119236 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.119512 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.119668 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.119813 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.119956 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.120100 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.120243 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.120387 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.120548 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.120726 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.120902 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.121614 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.121773 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.121962 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.122116 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.122259 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.122410 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.122551 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.122701 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.122852 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.123003 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.123147 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.123290 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.123433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.123584 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.123735 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.123886 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.124052 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.124214 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.124359 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.124510 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.124684 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.124829 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.124987 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.125130 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.125296 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.125450 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.125595 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.125736 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.125922 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.126073 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.126225 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.126386 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.126541 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.126692 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.126844 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.127001 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.127147 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.127300 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.127447 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.127590 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.127735 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.127879 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.128022 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.128179 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.128323 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.128489 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.128654 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.128815 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.128978 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.129128 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.129275 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.129427 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.129654 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.129810 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.129996 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.130141 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.130285 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.130437 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.130584 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.130726 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.130985 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.131173 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.131328 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.131473 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.131639 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.131807 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.131965 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.132116 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.132271 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.132271 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.132557 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.132717 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.132867 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.133029 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.133179 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.133328 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.133478 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.133635 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.133787 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.133997 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.134152 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.134303 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.134446 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.134599 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.134743 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.134894 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.135043 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.135193 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.135335 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.135487 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.135631 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.135781 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.135923 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.136076 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.136226 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.136368 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.136518 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.136706 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.136882 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.137034 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.137211 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.137354 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.137526 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.137708 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.137890 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.138040 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.138204 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.138349 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.138493 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.138643 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.138788 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.138947 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.139105 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.139249 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.139396 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.139541 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.139698 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.139929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.140079 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.140223 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.140883 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.141061 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.141243 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.141469 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.141621 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.141783 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.142069 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.142217 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.142416 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.142627 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.142773 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.143037 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.143207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.143377 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.143697 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.143841 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.143991 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.144365 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.144510 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.144731 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.144953 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.145099 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.145365 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.145509 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.145680 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.146035 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.146191 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.146366 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.146682 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.146831 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.146992 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.147245 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.147404 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.147624 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.147849 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.148000 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.148286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.148479 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.148632 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.148915 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.149064 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.149218 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.149521 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.149672 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.150172 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.150336 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.150493 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.150780 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.150934 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.151090 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.151388 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.151544 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.151695 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.151988 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.152146 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.152323 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.152601 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.152752 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.152901 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.153192 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.153345 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.153500 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.153786 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.153994 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.154152 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.154416 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.154559 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.154724 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.155015 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.155160 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.155334 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.155647 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.155807 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.155950 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.156090 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.156238 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.156418 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.156569 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.156764 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.156908 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.157109 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.157252 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.157442 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.157585 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.157784 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.157981 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.158128 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.158284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.158428 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.158580 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.158736 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.158882 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.159049 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.159205 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.159380 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.159527 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.159703 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.159855 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.160018 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.160383 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.160541 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.160695 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.160842 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.161000 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.161154 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.161298 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.161482 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.161717 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.161929 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.162098 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.162274 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.162429 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.162572 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.162715 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.162864 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.163014 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.163166 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.163310 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.163453 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.163630 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.163782 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.163926 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.164149 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.164300 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.164457 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.164613 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.164761 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.164914 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.165065 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.165209 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.165352 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.165494 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.165637 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.165792 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.165969 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.166119 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.166269 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.166426 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.166574 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.166730 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.166883 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.167032 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.167179 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.167328 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.167485 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.167633 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.167787 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.167956 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.167956 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.168246 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.168409 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.168558 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.168705 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.168866 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.169022 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.169177 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.169177 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.169479 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.169625 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.169779 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.169986 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.170130 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.170130 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.170505 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.170658 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.170801 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.170949 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.171106 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.171249 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.171399 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.171558 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.171735 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.171870 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.172000 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.172120 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.172245 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.172245 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:02:37.172620 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.172620 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.172955 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.172955 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.173263 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.173582 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.173927 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.174285 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.174597 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.174910 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.175245 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.175571 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.175899 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.176222 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.176541 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.176878 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.177204 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.177519 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.177851 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.178174 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.178490 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.178818 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.179134 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.179450 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.179773 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.180096 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.180431 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.180764 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.181082 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.181416 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.181748 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.182132 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.182458 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.182828 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.183145 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.184049 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.184309 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.184624 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:02:37.185138 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:02:37.328249 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO dbcounter [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Registered counter for database nova_api Jul 28 09:02:37.346415 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Registered counter for database nova_api Jul 28 09:02:37.348317 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:02:37.354784 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writer thread running {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:02:37.366866 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:02:37.374203 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:02:37.410784 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.context [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),16c49c6f-9465-40a7-880f-cddb465d5406(cell1) {{(pid=103339) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 09:02:37.414718 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:02:37.416289 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:02:37.417092 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:02:37.419648 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG oslo_concurrency.lockutils [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:02:37.421653 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO dbcounter [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Registered counter for database nova_cell0 Jul 28 09:02:37.427318 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO dbcounter [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Registered counter for database nova_cell1 Jul 28 09:02:37.429605 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.context [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),16c49c6f-9465-40a7-880f-cddb465d5406(cell1) {{(pid=103340) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 09:02:37.434356 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:02:37.436025 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:02:37.436233 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:02:37.437047 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:02:37.439088 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:02:37.441128 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Registered counter for database nova_cell0 Jul 28 09:02:37.441251 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writer thread running {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:02:37.447206 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Registered counter for database nova_cell1 Jul 28 09:02:37.454127 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:02:37.457779 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:02:37.460280 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:02:37.576581 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:02:37.582248 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writer thread running {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:02:37.591690 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO dbcounter [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Registered counter for database nova_cell0 Jul 28 09:02:37.599800 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:02:37.600502 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:02:37.605257 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writer thread running {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:02:37.609584 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Registered counter for database nova_cell0 Jul 28 09:02:37.618275 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:02:37.623410 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:02:37.940801 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:02:37.944102 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: WARNING keystonemiddleware.auth_token [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:02:37.948088 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:02:37.951390 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: WARNING keystonemiddleware.auth_token [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:02:38.287807 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:02:38.293793 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:02:38.298401 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: WARNING keystonemiddleware.auth_token [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:02:38.299153 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f320b89c0 pid: 103340 (default app) Jul 28 09:02:38.301429 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:02:38.302664 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001986 Jul 28 09:02:38.303062 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Thu Jul 28 09:02:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:02:38.304378 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: WARNING keystonemiddleware.auth_token [None req-0fb714b3-a014-46cc-b747-17df18082ae9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:02:38.309725 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562f320b89c0 pid: 103339 (default app) Jul 28 09:03:55.424803 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:03:55.425815 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 28 09:03:55.426401 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:03:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:03:55.438833 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=3 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:03:55.439581 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_cell0:SELECT=3 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:03:55.440592 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_cell1:SELECT=3 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:03:55.441598 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:03:56.351261 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-11a32355-05bc-43f6-9991-0ad20038ee5b admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:03:56.394040 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-11a32355-05bc-43f6-9991-0ad20038ee5b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.960191 Jul 28 09:03:56.394720 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 28 09:03:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:03:58.649593 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:03:58.652857 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-65432e74-bbae-4018-b75e-7817cdfd90ea None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003151 Jul 28 09:03:58.653624 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:03:58 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:03:59.106612 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e033a8d2-2087-4100-8636-d8bfe53ef02e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:03:59.126987 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:03:59.126987 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: warnings.warn(msg) Jul 28 09:03:59.157388 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e033a8d2-2087-4100-8636-d8bfe53ef02e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496947 Jul 28 09:03:59.157982 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:03:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:03:59.171754 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:03:59.173101 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:03:59.174077 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell1:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:03:59.175022 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:03:59.400206 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-e36b4afa-0888-4c38-8149-f60d4f3612f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:03:59.405517 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:03:59.405517 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jul 28 09:03:59.477496 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-e36b4afa-0888-4c38-8149-f60d4f3612f5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.310831 Jul 28 09:03:59.482867 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 09:03:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:04:01.704070 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e033a8d2-2087-4100-8636-d8bfe53ef02e admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:01.705232 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e033a8d2-2087-4100-8636-d8bfe53ef02e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 28 09:04:01.705599 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:02.365953 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-6f73f9c4-9d3f-43b8-89fb-70fa889a78bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "swap": 0, "id": "d1", "name": "ds512M"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:02.384599 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:04:02.384599 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jul 28 09:04:02.405883 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-6f73f9c4-9d3f-43b8-89fb-70fa889a78bc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.693998 Jul 28 09:04:02.407144 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:04:02.419917 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-3fe725ac-1c87-4e2a-bca2-7ea10f22ac5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:02.423202 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:04:02.423202 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: warnings.warn(msg) Jul 28 09:04:02.457421 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-3fe725ac-1c87-4e2a-bca2-7ea10f22ac5f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041430 Jul 28 09:04:02.458333 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 09:04:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:04:04.648769 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-6f73f9c4-9d3f-43b8-89fb-70fa889a78bc admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:04.649788 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-6f73f9c4-9d3f-43b8-89fb-70fa889a78bc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 28 09:04:04.650219 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:05.056882 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-f4640799-7e36-4489-bfa1-cd6f6d421708 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "ram": 1024, "swap": 0, "disk": 10, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:05.077515 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-f4640799-7e36-4489-bfa1-cd6f6d421708 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420357 Jul 28 09:04:05.078027 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:04:05.090462 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-2ca94bce-8375-4b23-b1de-4e290cb39cbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:05.114243 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-2ca94bce-8375-4b23-b1de-4e290cb39cbf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027679 Jul 28 09:04:05.114791 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 09:04:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:04:07.281501 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-f4640799-7e36-4489-bfa1-cd6f6d421708 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:07.282562 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-f4640799-7e36-4489-bfa1-cd6f6d421708 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 28 09:04:07.282974 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:07.735433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-e473e631-d3cb-45b6-a245-74e3200ce496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:07.759212 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-e473e631-d3cb-45b6-a245-74e3200ce496 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465449 Jul 28 09:04:07.759212 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:04:07.767950 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-73f587b2-80aa-47da-9315-0c48ecf26756 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:07.801097 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-73f587b2-80aa-47da-9315-0c48ecf26756 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037264 Jul 28 09:04:07.801686 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 09:04:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:04:10.038450 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-e473e631-d3cb-45b6-a245-74e3200ce496 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:10.039606 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-e473e631-d3cb-45b6-a245-74e3200ce496 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Jul 28 09:04:10.040295 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:10.466445 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-940939c3-1f53-4655-a816-6bda1053b0d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:10.486720 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-940939c3-1f53-4655-a816-6bda1053b0d7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440465 Jul 28 09:04:10.487627 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:04:10.499684 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-412ab592-eb0c-4b2a-a2aa-54958642bd9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:10.525689 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-412ab592-eb0c-4b2a-a2aa-54958642bd9e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029569 Jul 28 09:04:10.526686 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 09:04:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:04:12.849183 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-940939c3-1f53-4655-a816-6bda1053b0d7 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:12.850215 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-940939c3-1f53-4655-a816-6bda1053b0d7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 28 09:04:12.850630 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:04:13.338975 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-ff7ef4c9-f57e-41ad-8ead-1a555552a958 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:13.371311 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-ff7ef4c9-f57e-41ad-8ead-1a555552a958 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.514523 Jul 28 09:04:13.372004 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 28 09:04:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:04:16.014751 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-940939c3-1f53-4655-a816-6bda1053b0d7 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:16.015632 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-940939c3-1f53-4655-a816-6bda1053b0d7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 28 09:04:16.016028 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:16.482276 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-1373f66f-8e8b-4d6a-8098-7cd6ff58d86b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:16.502810 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-1373f66f-8e8b-4d6a-8098-7cd6ff58d86b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.480832 Jul 28 09:04:16.503367 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:04:16.515760 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-5d3e3500-e390-408d-a5a3-c906604f7d1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:16.543393 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-5d3e3500-e390-408d-a5a3-c906604f7d1c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031105 Jul 28 09:04:16.548202 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 09:04:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:04:18.719850 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-1373f66f-8e8b-4d6a-8098-7cd6ff58d86b admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:18.720924 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-1373f66f-8e8b-4d6a-8098-7cd6ff58d86b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Jul 28 09:04:18.721322 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:19.127527 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-77a56452-9e84-4a71-a541-eab818c66b38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:19.145641 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-77a56452-9e84-4a71-a541-eab818c66b38 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418497 Jul 28 09:04:19.146146 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:04:19.158424 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-6e06b088-0cc4-4b3f-bdd5-0df241bddc44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:19.182800 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-6e06b088-0cc4-4b3f-bdd5-0df241bddc44 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028105 Jul 28 09:04:19.183353 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 09:04:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:04:21.387690 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-77a56452-9e84-4a71-a541-eab818c66b38 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:21.388722 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-77a56452-9e84-4a71-a541-eab818c66b38 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 09:04:21.389119 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:21.760408 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3b89b035-c843-4bbc-9174-192fe758988f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "id": "3", "name": "m1.medium"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:21.781637 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3b89b035-c843-4bbc-9174-192fe758988f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.386271 Jul 28 09:04:21.787344 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:04:21.802142 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-ae592e3e-b8ba-4b66-aa18-3345776b2b2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:21.828668 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-ae592e3e-b8ba-4b66-aa18-3345776b2b2e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030337 Jul 28 09:04:21.834022 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 09:04:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:04:24.064436 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3b89b035-c843-4bbc-9174-192fe758988f admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:24.065461 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3b89b035-c843-4bbc-9174-192fe758988f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 28 09:04:24.065889 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:24.500757 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e808fcbe-fb41-4228-978e-16826229370a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:24.529991 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e808fcbe-fb41-4228-978e-16826229370a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458074 Jul 28 09:04:24.530959 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:04:24.543335 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-2f40e7bf-1dc6-435d-9d68-96a433dec467 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:24.575659 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-2f40e7bf-1dc6-435d-9d68-96a433dec467 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036012 Jul 28 09:04:24.576702 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 09:04:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:04:26.782699 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-e808fcbe-fb41-4228-978e-16826229370a admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:26.784741 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-e808fcbe-fb41-4228-978e-16826229370a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.009192 Jul 28 09:04:26.786217 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:26 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:27.278372 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5316752b-94f9-4a16-835c-1019cb2892af admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:27.302078 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5316752b-94f9-4a16-835c-1019cb2892af admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.502716 Jul 28 09:04:27.305787 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 09:04:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:04:27.315468 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-9e1996f9-0a21-41d5-8c1e-6c7f383c3dd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:27.320753 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:04:27.348824 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-9e1996f9-0a21-41d5-8c1e-6c7f383c3dd0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037226 Jul 28 09:04:27.349466 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 09:04:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:04:47.067335 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5316752b-94f9-4a16-835c-1019cb2892af admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:47.068346 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5316752b-94f9-4a16-835c-1019cb2892af admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 28 09:04:47.068746 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:04:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:47.079166 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:04:47.460294 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-fcef1aa8-433e-4dd3-8e35-a1e66e2f4712 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:47.478867 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-fcef1aa8-433e-4dd3-8e35-a1e66e2f4712 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404040 Jul 28 09:04:47.479336 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 28 09:04:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:04:48.533007 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5316752b-94f9-4a16-835c-1019cb2892af admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:48.534025 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5316752b-94f9-4a16-835c-1019cb2892af admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 28 09:04:48.534414 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:04:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:49.050286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-5a955a50-133d-4ea0-b32a-5669586fdff1 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:49.055805 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.wsgi [None req-5a955a50-133d-4ea0-b32a-5669586fdff1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-5a955a50-133d-4ea0-b32a-5669586fdff1 admin admin] Request method failure captured: Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Accept: application/json Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Accept-Encoding: gzip, deflate Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Connection: keep-alive Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Content-Length: 0 Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Host: 10.222.0.48 Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Openstack-Api-Version: compute 2.90 Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Openstack-System-Scope: None Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: User-Agent: python-novaclient Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Auth-Token: gAAAAABi4lEwExgcqrzGqMgPUrQIkzbRXodTvKW4jojq3WQInhc4rJG0vg__pTmSGpiQcj2xoz87qHxp0NeyArYLOlVkST4Q837f3po3wbc7yZZ5VynG0QJ1UtGaY6nFULXqs7FTsSzfgEZv5OcTvuDZoSH2yv2zWmMQqdp4JNjMckmxHroFQmc Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Domain-Id: None Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Domain-Name: None Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Identity-Status: Confirmed Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Is-Admin-Project: True Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Domain-Id: default Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Domain-Name: Default Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Name: admin Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Role: reader,admin,member Jul 28 09:04:49.059523 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Roles: reader,admin,member Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_66b6795243644c5d8ae6b99e815d8914", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}] Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant: admin Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant-Name: admin Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User: admin Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Domain-Id: default Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Domain-Name: Default Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Id: 7b84f6da05694fb8ade9ceaae63ccb08 Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Name: admin Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: method: > Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: exception: Flavor 42 could not be found. Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: action_args: {'id': '42'} Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:04:49.061169 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:49.062518 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.063973 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-5a955a50-133d-4ea0-b32a-5669586fdff1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:04:49.065218 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-5a955a50-133d-4ea0-b32a-5669586fdff1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388637 Jul 28 09:04:49.065218 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 28 09:04:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 09:04:49.070838 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-a6a12510-e448-4365-9f1e-a1a2ade8f5de admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:49.075605 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:04:49.094813 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-a6a12510-e448-4365-9f1e-a1a2ade8f5de admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027477 Jul 28 09:04:49.095347 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 09:04:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:04:49.104959 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-b4dffed9-cc2d-4727-a610-def18883b7b4 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:49.128741 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-b4dffed9-cc2d-4727-a610-def18883b7b4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027325 Jul 28 09:04:49.129267 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 09:04:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:04:49.138927 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-31e8521e-3d57-4800-adbd-e58f7a243645 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:49.145088 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-31e8521e-3d57-4800-adbd-e58f7a243645 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-31e8521e-3d57-4800-adbd-e58f7a243645 admin admin] Request method failure captured: Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Accept: application/json Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Connection: keep-alive Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Content-Length: 0 Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Host: 10.222.0.48 Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABi4lEwExgcqrzGqMgPUrQIkzbRXodTvKW4jojq3WQInhc4rJG0vg__pTmSGpiQcj2xoz87qHxp0NeyArYLOlVkST4Q837f3po3wbc7yZZ5VynG0QJ1UtGaY6nFULXqs7FTsSzfgEZv5OcTvuDZoSH2yv2zWmMQqdp4JNjMckmxHroFQmc Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Role: reader,admin,member Jul 28 09:04:49.148284 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Roles: reader,admin,member Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_66b6795243644c5d8ae6b99e815d8914", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}] Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant: admin Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User: admin Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Id: 7b84f6da05694fb8ade9ceaae63ccb08 Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Name: admin Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: method: > Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: exception: Flavor 42 could not be found. Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: action_args: {'id': '42'} Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:04:49.149820 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:49.150929 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:49.152314 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-31e8521e-3d57-4800-adbd-e58f7a243645 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:04:49.153305 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-31e8521e-3d57-4800-adbd-e58f7a243645 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014792 Jul 28 09:04:49.153305 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 28 09:04:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 09:04:50.121745 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-b4dffed9-cc2d-4727-a610-def18883b7b4 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:50.122797 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-b4dffed9-cc2d-4727-a610-def18883b7b4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 28 09:04:50.123195 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:04:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:50.638990 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-0a55ff3c-107d-4262-8440-504517057693 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:50.644228 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-0a55ff3c-107d-4262-8440-504517057693 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-0a55ff3c-107d-4262-8440-504517057693 admin admin] Request method failure captured: Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Accept: application/json Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Connection: keep-alive Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Content-Length: 0 Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Host: 10.222.0.48 Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABi4lEyhSKMFaz0wrbCBur1Zpwr5NFMz0ePxkUc-Ve1wxDbFGwd98tvoHX951ufMfGwEAvfjmqHeJ1uTuP0V9sZQ03HTBFXT5mldWL0M-XyjfKZDaGlMe3p7ss7UjnEA70hL2D3-4P9cq1RCCr1zPT4IhH4YKgc45La2rvEnSH4mg7LuRs Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Role: reader,admin,member Jul 28 09:04:50.645711 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Roles: reader,admin,member Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_66b6795243644c5d8ae6b99e815d8914", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}] Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant: admin Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User: admin Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Id: 7b84f6da05694fb8ade9ceaae63ccb08 Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Name: admin Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: method: > Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: exception: Flavor 84 could not be found. Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: action_args: {'id': '84'} Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:04:50.647010 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:50.647885 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.649207 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-0a55ff3c-107d-4262-8440-504517057693 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:04:50.650456 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-0a55ff3c-107d-4262-8440-504517057693 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.385651 Jul 28 09:04:50.650456 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 28 09:04:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 09:04:50.657362 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-eb5ddf0b-5996-4122-88b0-3ac58c1ebae7 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:50.672730 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-eb5ddf0b-5996-4122-88b0-3ac58c1ebae7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019017 Jul 28 09:04:50.673251 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 09:04:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:04:50.682464 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-0cc418da-2d23-4b09-bcfb-85bce95ab996 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:50.699004 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-0cc418da-2d23-4b09-bcfb-85bce95ab996 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019994 Jul 28 09:04:50.699527 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 09:04:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:04:50.708705 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-5fbc098e-566d-48e5-9a2c-181d4e385079 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:50.714784 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.wsgi [None req-5fbc098e-566d-48e5-9a2c-181d4e385079 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-5fbc098e-566d-48e5-9a2c-181d4e385079 admin admin] Request method failure captured: Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Accept: application/json Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Accept-Encoding: gzip, deflate Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Connection: keep-alive Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Content-Length: 0 Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Host: 10.222.0.48 Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Openstack-Api-Version: compute 2.90 Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Openstack-System-Scope: None Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: User-Agent: python-novaclient Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Auth-Token: gAAAAABi4lEyhSKMFaz0wrbCBur1Zpwr5NFMz0ePxkUc-Ve1wxDbFGwd98tvoHX951ufMfGwEAvfjmqHeJ1uTuP0V9sZQ03HTBFXT5mldWL0M-XyjfKZDaGlMe3p7ss7UjnEA70hL2D3-4P9cq1RCCr1zPT4IhH4YKgc45La2rvEnSH4mg7LuRs Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Domain-Id: None Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Domain-Name: None Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Identity-Status: Confirmed Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Is-Admin-Project: True Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Domain-Id: default Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Domain-Name: Default Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Name: admin Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Role: reader,admin,member Jul 28 09:04:50.716286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Roles: reader,admin,member Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_66b6795243644c5d8ae6b99e815d8914", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}] Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant: admin Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant-Name: admin Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User: admin Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Domain-Id: default Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Domain-Name: Default Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Id: 7b84f6da05694fb8ade9ceaae63ccb08 Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Name: admin Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: method: > Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: exception: Flavor 84 could not be found. Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: action_args: {'id': '84'} Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:04:50.717747 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:50.718692 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:50.720125 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-5fbc098e-566d-48e5-9a2c-181d4e385079 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:04:50.721507 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-5fbc098e-566d-48e5-9a2c-181d4e385079 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012459 Jul 28 09:04:50.721507 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 28 09:04:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 09:04:51.676871 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-0cc418da-2d23-4b09-bcfb-85bce95ab996 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:51.677903 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-0cc418da-2d23-4b09-bcfb-85bce95ab996 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 28 09:04:51.678303 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:04:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:52.321957 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-1e4ed265-dd12-47d6-ae43-4ba536f4aa46 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:52.327628 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.wsgi [None req-1e4ed265-dd12-47d6-ae43-4ba536f4aa46 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-1e4ed265-dd12-47d6-ae43-4ba536f4aa46 admin admin] Request method failure captured: Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Accept: application/json Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Accept-Encoding: gzip, deflate Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Connection: keep-alive Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Content-Length: 0 Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Host: 10.222.0.48 Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Openstack-Api-Version: compute 2.90 Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Openstack-System-Scope: None Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: User-Agent: python-novaclient Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Auth-Token: gAAAAABi4lEzZfw6gUk7B8qxc_9tF-TfZUhlyWJ-1-UyFsvkKtQd4vGnhlZp6w1F8dloZ-h_7In6QKUgTTeA1N03amN5zi1XS0_1ps1lW0JXJxBwRnt_oW-HZ_wPHWUAt0D-N5auDK6BIqMJMHMxUCrWIz-SGovV7B8zTLcocqlSVWrw_cWD_2U Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Domain-Id: None Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Domain-Name: None Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Identity-Status: Confirmed Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Is-Admin-Project: True Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Domain-Id: default Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Domain-Name: Default Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Project-Name: admin Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Role: reader,admin,member Jul 28 09:04:52.329112 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Roles: reader,admin,member Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_66b6795243644c5d8ae6b99e815d8914", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}] Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant: admin Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-Tenant-Name: admin Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User: admin Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Domain-Id: default Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Domain-Name: Default Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Id: 7b84f6da05694fb8ade9ceaae63ccb08 Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: X-User-Name: admin Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: method: > Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: exception: Flavor 451 could not be found. Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: action_args: {'id': '451'} Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:04:52.330688 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:52.331704 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.333042 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-1e4ed265-dd12-47d6-ae43-4ba536f4aa46 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:04:52.334336 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-1e4ed265-dd12-47d6-ae43-4ba536f4aa46 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.514374 Jul 28 09:04:52.334336 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 09:04:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 09:04:52.340541 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c01683f1-4913-49e0-833c-6eafbf2ab42d admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:52.355790 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c01683f1-4913-49e0-833c-6eafbf2ab42d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019274 Jul 28 09:04:52.356310 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 09:04:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:04:52.365422 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:52.380014 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018033 Jul 28 09:04:52.380532 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 09:04:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:04:52.390136 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-751f446c-7421-47a6-81e9-e44d63bc8774 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:52.395377 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-751f446c-7421-47a6-81e9-e44d63bc8774 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-751f446c-7421-47a6-81e9-e44d63bc8774 admin admin] Request method failure captured: Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Accept: application/json Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Connection: keep-alive Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Content-Length: 0 Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Host: 10.222.0.48 Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABi4lEzZfw6gUk7B8qxc_9tF-TfZUhlyWJ-1-UyFsvkKtQd4vGnhlZp6w1F8dloZ-h_7In6QKUgTTeA1N03amN5zi1XS0_1ps1lW0JXJxBwRnt_oW-HZ_wPHWUAt0D-N5auDK6BIqMJMHMxUCrWIz-SGovV7B8zTLcocqlSVWrw_cWD_2U Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Role: reader,admin,member Jul 28 09:04:52.396854 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Roles: reader,admin,member Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_66b6795243644c5d8ae6b99e815d8914", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/66b6795243644c5d8ae6b99e815d8914"}]}] Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant: admin Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant-Id: 66b6795243644c5d8ae6b99e815d8914 Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User: admin Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Id: 7b84f6da05694fb8ade9ceaae63ccb08 Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: X-User-Name: admin Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: method: > Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: exception: Flavor 451 could not be found. Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: action_args: {'id': '451'} Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:04:52.398433 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:52.399393 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Jul 28 09:04:52.400651 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-751f446c-7421-47a6-81e9-e44d63bc8774 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:04:52.402461 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-751f446c-7421-47a6-81e9-e44d63bc8774 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011518 Jul 28 09:04:52.402461 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 09:04:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 09:04:53.354248 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:53.355261 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Jul 28 09:04:53.355646 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:04:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:53.865557 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-50b6ae26-ca2c-4775-b9c1-3e163b33aa83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:53.884387 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-50b6ae26-ca2c-4775-b9c1-3e163b33aa83 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.393105 Jul 28 09:04:53.885448 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 28 09:04:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:04:54.845230 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:54.846286 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 28 09:04:54.846676 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:04:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:55.367201 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5e937a8c-63fc-4bbd-b22c-4df83d4be982 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:55.386850 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5e937a8c-63fc-4bbd-b22c-4df83d4be982 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.401579 Jul 28 09:04:55.387397 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 28 09:04:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:04:56.352560 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:56.353561 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 28 09:04:56.354519 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:04:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:56.873225 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-488d7e93-cd41-422e-9069-334a167b54d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:56.892417 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-488d7e93-cd41-422e-9069-334a167b54d8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400248 Jul 28 09:04:56.892945 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 28 09:04:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:04:57.860985 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:57.862036 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 28 09:04:57.862431 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:04:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:58.442143 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-7034f414-8957-401c-b4c1-01b99ae69d54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:04:58.462329 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-7034f414-8957-401c-b4c1-01b99ae69d54 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.462110 Jul 28 09:04:58.462886 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 28 09:04:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:04:59.433861 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:59.434864 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 28 09:04:59.435260 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:04:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:04:59.950029 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-0c49c1a1-47ed-44a8-bcc9-8a2e18677a41 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:04:59.969827 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-0c49c1a1-47ed-44a8-bcc9-8a2e18677a41 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.398262 Jul 28 09:04:59.970377 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Thu Jul 28 09:04:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:05:50.773302 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:05:50.774334 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-fae8db35-a5a9-4d28-a3c3-ec0a9b9c47cb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 28 09:05:50.775744 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 09:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:05:50.785779 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:51.157562 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-6004de6c-d42f-4d83-ba62-a1697106bc6d admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:05:51.177333 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-6004de6c-d42f-4d83-ba62-a1697106bc6d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.396001 Jul 28 09:05:51.177798 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 28 09:05:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:05:51.200923 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-4cb9e3bf-bb45-4f7c-9e53-2fe5bdf16ab3 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:05:51.204495 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG dbcounter [-] [103339] Writing DB stats nova_api:SELECT=14 {{(pid=103339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:51.210546 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-4cb9e3bf-bb45-4f7c-9e53-2fe5bdf16ab3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013855 Jul 28 09:05:51.211074 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Thu Jul 28 09:05:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:51.223422 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f0fb34af-cb67-4c55-beb9-ed75f5763efd admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:05:51.230938 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-f0fb34af-cb67-4c55-beb9-ed75f5763efd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011421 Jul 28 09:05:51.231446 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Thu Jul 28 09:05:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:51.242483 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:05:51.250539 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011535 Jul 28 09:05:51.251052 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Thu Jul 28 09:05:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:51.263672 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-a00528fa-c87b-4f93-82b4-37fb81f96585 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:05:51.271584 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-a00528fa-c87b-4f93-82b4-37fb81f96585 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012326 Jul 28 09:05:51.272101 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Thu Jul 28 09:05:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:09:13.447558 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:09:13.448608 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 28 09:09:13.449000 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:09:13.589384 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=6 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:13.743697 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-376d1cf7-dc01-4a54-bef3-7e8516d04463 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:09:13.746026 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:09:13.746026 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jul 28 09:09:13.747229 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-376d1cf7-dc01-4a54-bef3-7e8516d04463 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:09:13.747669 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-376d1cf7-dc01-4a54-bef3-7e8516d04463 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:09:13.748477 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-376d1cf7-dc01-4a54-bef3-7e8516d04463 admin admin] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:09:13.748907 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-376d1cf7-dc01-4a54-bef3-7e8516d04463 admin admin] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:09:13.783016 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-376d1cf7-dc01-4a54-bef3-7e8516d04463 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.195020 Jul 28 09:09:13.783561 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 09:09:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:09:14.604472 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:09:14.605588 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 28 09:09:14.606011 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:09:14.794970 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-da5c39b4-424a-4c4f-8837-ed7289659fb5 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:09:14.797339 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:09:14.797339 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jul 28 09:09:14.799200 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-da5c39b4-424a-4c4f-8837-ed7289659fb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:09:14.799648 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-da5c39b4-424a-4c4f-8837-ed7289659fb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:09:14.800440 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-da5c39b4-424a-4c4f-8837-ed7289659fb5 admin admin] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:09:14.800876 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-da5c39b4-424a-4c4f-8837-ed7289659fb5 admin admin] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:09:14.820297 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-da5c39b4-424a-4c4f-8837-ed7289659fb5 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075391 Jul 28 09:09:14.820779 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 09:09:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:09:26.063173 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:09:26.064714 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jul 28 09:09:26.065108 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:09:26.208378 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:26.209023 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell1:SELECT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:26.209635 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=8 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:26.257024 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5c6b619e-e157-4edb-aa13-30001089bd9f admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:09:26.259451 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:09:26.259451 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jul 28 09:09:26.260656 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-5c6b619e-e157-4edb-aa13-30001089bd9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:09:26.261094 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-5c6b619e-e157-4edb-aa13-30001089bd9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:09:26.261899 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-5c6b619e-e157-4edb-aa13-30001089bd9f admin admin] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:09:26.262328 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-5c6b619e-e157-4edb-aa13-30001089bd9f admin admin] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:09:26.287224 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5c6b619e-e157-4edb-aa13-30001089bd9f admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084650 Jul 28 09:09:26.287770 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 09:09:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:09:27.104600 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: DEBUG nova.api.openstack.wsgi [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] Calling method '>' {{(pid=103339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:09:27.105605 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: INFO nova.api.openstack.requestlog [None req-ce3b7426-c060-4607-89cd-8c6dd29470b1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 28 09:09:27.106031 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: [pid: 103339|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 09:09:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:09:27.296248 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-bd5b92db-3ce5-44bb-a0de-d666a822b13c admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:09:27.298696 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:09:27.298696 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Jul 28 09:09:27.299913 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-bd5b92db-3ce5-44bb-a0de-d666a822b13c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:09:27.300351 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-bd5b92db-3ce5-44bb-a0de-d666a822b13c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:09:27.301138 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-bd5b92db-3ce5-44bb-a0de-d666a822b13c admin admin] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:09:27.301563 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-bd5b92db-3ce5-44bb-a0de-d666a822b13c admin admin] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:09:27.323226 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-bd5b92db-3ce5-44bb-a0de-d666a822b13c admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078265 Jul 28 09:09:27.323702 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 09:09:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:10:25.667023 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: Thu Jul 28 09:10:25 2022 - graceful shutdown triggered... Jul 28 09:10:25.666768 dv-cinder-851249-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 09:10:25.667972 dv-cinder-851249-5-iscsi devstack@n-api.service[103339]: Gracefully killing worker 1 (pid: 103339)... Jul 28 09:10:25.668341 dv-cinder-851249-5-iscsi devstack@n-api.service[103340]: Gracefully killing worker 2 (pid: 103340)... Jul 28 09:10:26.666844 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: worker 1 buried after 1 seconds Jul 28 09:10:26.667063 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: worker 2 buried after 1 seconds Jul 28 09:10:26.667063 dv-cinder-851249-5-iscsi devstack@n-api.service[103338]: goodbye to uWSGI. Jul 28 09:10:26.668397 dv-cinder-851249-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 09:10:26.668946 dv-cinder-851249-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 09:10:26.671821 dv-cinder-851249-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 09:10:26.680792 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 09:10:26 2022] *** Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: nodename: dv-cinder-851249-5-iscsi Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: machine: x86_64 Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: clock source: unix Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: pcre jit disabled Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: detected number of CPU cores: 4 Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: current working directory: / Jul 28 09:10:26.682939 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: detected binary path: /usr/bin/uwsgi-core Jul 28 09:10:26.683595 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: your processes number limit is 47680 Jul 28 09:10:26.683595 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: your memory page size is 4096 bytes Jul 28 09:10:26.683595 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: detected max file descriptor number: 2048 Jul 28 09:10:26.683595 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: lock engine: pthread robust mutexes Jul 28 09:10:26.683595 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: thunder lock: enabled Jul 28 09:10:26.683595 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 09:10:26.683595 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 09:10:26.725141 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: Python main interpreter initialized at 0x558918fb79c0 Jul 28 09:10:26.725141 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: python threads support enabled Jul 28 09:10:26.725141 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: your server socket listen backlog is limited to 100 connections Jul 28 09:10:26.725141 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: your mercy for graceful operations on workers is 90 seconds Jul 28 09:10:26.725614 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 09:10:26.725614 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: *** Operational MODE: preforking *** Jul 28 09:10:26.725960 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: *** uWSGI is running in multiple interpreter mode *** Jul 28 09:10:26.725960 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: spawned uWSGI master process (pid: 117846) Jul 28 09:10:26.726151 dv-cinder-851249-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 09:10:26.729300 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: spawned uWSGI worker 1 (pid: 117863, cores: 1) Jul 28 09:10:26.729631 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: spawned uWSGI worker 2 (pid: 117864, cores: 1) Jul 28 09:10:26.729962 dv-cinder-851249-5-iscsi devstack@n-api.service[117846]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 09:10:27.393187 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 09:10:27.398713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 09:10:28.542933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:10:28.542933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: from cryptography.utils import int_from_bytes Jul 28 09:10:28.543591 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:10:28.543591 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: from cryptography.utils import int_from_bytes Jul 28 09:10:28.546748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:10:28.546748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: from cryptography.utils import int_from_bytes Jul 28 09:10:28.547734 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:10:28.547734 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: from cryptography.utils import int_from_bytes Jul 28 09:10:30.949762 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:10:30.950384 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:10:30.950585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:10:30.950950 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:10:30.951212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:10:30.951684 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.952026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.952337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.952653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.952983 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.953292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.953611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.953956 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.954300 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.954544 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.954857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.955178 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-5-iscsi {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.955495 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.955965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.956276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.956595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.956928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.957251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.957567 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.958095 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.958539 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.958844 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.959151 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.959492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.959804 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.960107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.960642 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.961017 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.962120 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.962120 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.962120 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-5-iscsi {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.962424 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.962673 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.962981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.963400 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.963709 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.964014 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.964334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.964656 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.964958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.965437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.965940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.966267 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.966586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.966965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.967330 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.967845 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.968256 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.968525 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.968835 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.969084 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.969392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.969715 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.970059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.970381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.970632 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.970881 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.971201 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.971520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.971832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.972138 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.972425 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:10:30.972845 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.972950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:10:30.973052 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.973052 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.973221 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:10:30.973352 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.973561 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:10:30.973675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.973821 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:10:30.973967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.974234 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.974339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.974561 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.974665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.974883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.974993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.975188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.975287 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.975511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.975634 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.975820 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.975933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.976140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.976243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.976442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.976543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.976777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.976910 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.977040 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.977158 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.977355 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.977472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.977678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851249-5-iscsi {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.977783 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.978022 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.978115 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.978328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.978463 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.978632 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.978771 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.978940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.979089 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.979255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.979396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.979587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.979719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.979891 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.980037 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.980136 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.980428 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.980530 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.980732 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.980868 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.981051 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.981189 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.981355 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.981455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.981657 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.981747 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.981988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.982092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.982288 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.982389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.982674 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.982766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.982981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.983079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.983286 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.983381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.983591 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.983699 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.983897 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.984033 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851249-5-iscsi {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.984202 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.984305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.984507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.984617 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.984810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.984922 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.985111 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.985292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.985443 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.985603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.985732 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.985941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.986072 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.986267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.986360 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.986590 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.986695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.986900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.986990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.987227 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.987319 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.987547 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.987641 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.987849 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.987946 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.988696 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.988798 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.989053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.989153 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.989381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.989592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.989592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.989759 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.989917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.990021 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.990226 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.990356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.990529 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.990631 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.990789 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.990903 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.991092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.991192 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.991413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.991502 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.991718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.991816 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.992020 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.992131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.992317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.992427 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.992564 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.992706 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.992817 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.992965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.993131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.993286 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.994306 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.994494 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.994654 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.994813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.994963 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.995117 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.995258 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.995510 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.995661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.995802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.995942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.996112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.996353 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.996513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.996665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.996815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.996957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.997123 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.997392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.997563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:30.997717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.997885 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:30.998035 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.998175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:30.998316 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.998544 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:30.998689 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.998838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:30.998989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.998989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.999341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:30.999582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:30.999730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:30.999923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.000028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.000127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.000299 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.000517 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.000616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.000718 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.000808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.000952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.001059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.001228 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.001372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.001475 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.001559 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.001641 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.001801 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.002077 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.002172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.002274 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.002358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.002449 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.002449 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.002612 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.002702 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.002785 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.002867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.002961 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.003051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.003141 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.003224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.003311 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.003401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.003496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.003587 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.004406 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.004645 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.004813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.004908 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.005001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.005087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.005306 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.005502 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.005677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.005789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.006000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.006152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.006277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.006484 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.006582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.006766 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.006864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.007076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.007174 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.007400 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.007498 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.007729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.007820 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.008071 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.008242 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.008379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.008690 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.008843 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.009038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.009139 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.009374 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.009475 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.009616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.009925 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.010087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.010297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.010465 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.010611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.010800 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.010903 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.011023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.011174 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.011316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.011439 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.011589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.011759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.011905 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.012061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.012154 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.012369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.012495 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.012810 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.012958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.013054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.013151 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.013346 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.013439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.013572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.013860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.013968 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.014168 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.014274 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.014506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.014614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.014811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.014911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.015113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.015206 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.015414 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.015517 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.015736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.015841 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.016056 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.016150 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.016358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.016457 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.016666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.016784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.016968 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.017070 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.017272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.017370 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:10:31.017575 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.017678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.017902 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.018000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.018215 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.018320 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.018519 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.018627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.018843 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.018945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.019153 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.019268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.019483 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.019591 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.019805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.019911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.020112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.020274 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.020434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.020582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.020719 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.020865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.021016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.021162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.021310 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.021449 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.021594 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.021740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.021927 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.022073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.022225 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.022364 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.022532 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.022675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.022844 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.022994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.023177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.023322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.023505 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.023644 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.023808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.024023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.024170 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.024309 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.024455 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.024614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.024747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.024849 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.025026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.025178 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.025317 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.025454 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.025619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.025774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.025942 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.026048 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.026244 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.026376 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.026550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.026689 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.026850 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.027001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.027657 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.027768 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.027870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.027962 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028138 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028229 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028318 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028412 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028635 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028856 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.028959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.029169 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.029269 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.029494 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.029597 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.029795 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.030036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.030141 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.030228 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.030459 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.030569 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.030766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.030857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.031082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.031182 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.031395 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.031486 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.031715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.031805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.032028 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.032190 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.032412 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.032528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.032693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.032789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.032998 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.033081 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.033304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.033391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.033611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.033700 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.034197 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.034400 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.034558 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.034701 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.034701 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.035014 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.035166 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.035308 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.035455 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.035598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.035738 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.035887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.036029 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.036176 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.036323 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.036464 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.036619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.036774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.036774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.037058 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.037152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.037428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.037740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.038079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.038213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.038409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.038513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.038727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.038839 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.039177 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.039284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.039379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.039455 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.039657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.039765 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.039964 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.040069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.040282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.040412 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.040608 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.040730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.040916 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.041056 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.041230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.041325 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.041544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.041646 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.041891 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.042003 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.042207 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.042306 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.042521 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.042613 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.042826 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.042923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.043144 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.043235 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.043467 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.043564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.043795 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.043887 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.044104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.044201 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.044415 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.044513 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.044717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.044813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.045035 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.045132 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.045340 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.045432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.045646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.045744 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.045983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.046090 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.046295 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.046386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.046599 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.046745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.046904 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.047052 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.047212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.047350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.047519 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.047655 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.047821 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.047925 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.048131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.048220 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.048436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.048527 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.048738 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.048838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.049039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.049130 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.049341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.049440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.049660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.049758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.050005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.050112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.050328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.050437 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.051227 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.051316 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.051465 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.051564 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.051779 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.051878 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.052092 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.052190 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.052402 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.052500 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.052705 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.052801 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.053012 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.053110 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.053317 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.053414 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.053624 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.053721 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.053981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.054076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.054283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.054380 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.054598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.054697 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.054906 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.054995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.055212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.055309 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.055527 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.055784 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.055993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.056093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.056177 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.056301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.056436 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.056777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.056868 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.057112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.057357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.057446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.057737 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.057972 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.058065 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.058374 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.058523 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.058685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.058993 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.059084 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.059302 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.059613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.059709 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.059932 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.060209 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.060301 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.060613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.060870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.060979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.061398 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.061515 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.061679 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.061772 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.062096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.062232 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.062418 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.062702 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.062787 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.063110 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.063451 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.063790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.063927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.064121 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.064436 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.064577 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.064761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.064979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.065075 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.065308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.065389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.065641 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.065758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.066019 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.066761 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.066966 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.067312 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.067634 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.067949 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.068262 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.068571 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.068889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.069200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.069507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.069815 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.070410 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.070718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.070811 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.071036 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.071606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.071711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.071808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.071965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.072063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.072268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.072585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.072677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.072897 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.073162 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.073255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.073494 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.073761 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.073887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.074160 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.074362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.074477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.074784 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.074932 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.075164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.075426 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.075635 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.075732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.076002 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.076095 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.076364 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.076820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.076938 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.077025 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.077130 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.077290 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.077617 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.077802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.077988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.078288 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.078519 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.078613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.078839 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.079102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.079194 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.079464 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.079664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.079778 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.080090 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.080232 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.080395 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.080721 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.080831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.081021 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.081322 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.081743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.081879 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.081983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.082300 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.082443 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.082623 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.082945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.083045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.083268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.083543 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.083642 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.083915 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.084148 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.084250 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.084554 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.084733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.084867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.085173 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.085308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.085486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.085800 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.085961 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.086137 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.086444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.086534 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.086753 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.087064 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.087154 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.087369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.087719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.087830 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.087979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.088284 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.088525 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.088638 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.088889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.089116 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.089216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.089490 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.089714 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.089814 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.090161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.090339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.090529 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.090844 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.091058 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.091152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.091404 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.091700 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.092230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.092326 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.092409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.092409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.092688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.092780 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.092993 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.093282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.093451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.093611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.093889 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.093995 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.094239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.094481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.094582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.094841 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.095077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.095169 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.095448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.095662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.095755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.096056 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.096243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.096371 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.096683 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.096820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.096988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.097300 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.098165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.098261 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.098483 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.098598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.098802 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.099128 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.099220 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.099453 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.099716 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.099821 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.100063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.100302 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.100401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.100666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.100958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.101062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.101276 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.101479 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.101572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.101896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.102135 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.102255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.102505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.102663 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.102813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.103120 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.103294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.103446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.103758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.103855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.104065 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.104350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.104450 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.104668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.104936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.105033 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.105266 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.105564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.105659 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.105913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.106171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.106262 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.106526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.106755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.106886 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.107129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.107348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.107560 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.107728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.107934 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.108026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.108327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.108586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.108690 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.108927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.109161 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.109261 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.109520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.109742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.109854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.110168 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.110362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.110464 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.110768 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.110962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.111075 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.111411 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.111514 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.111736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.112055 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.112173 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.112381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.112653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.112755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.113053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.113820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.113958 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.114275 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.114472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.114574 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.114800 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.115028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.115119 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.115416 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.115611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.115732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.116044 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.116194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.116349 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.116675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.116773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.116991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.117276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.117375 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.117616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.117873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.117971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.118359 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.118479 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.118575 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.118879 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.119009 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.119191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.119500 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.119599 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.119811 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.120090 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.120182 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.120425 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.120666 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.120758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.121039 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.121260 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.121366 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.121651 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.121898 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.122147 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.122281 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.122482 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.122585 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.122884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.123116 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.123218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.123510 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.123611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.123816 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.124125 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.124214 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.124431 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.124740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.124838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.125046 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.125360 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.125490 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.125806 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.125947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.126147 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.126455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.126552 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.126828 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.127063 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.127176 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.127381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.127657 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.127751 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.127992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.128241 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.128512 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.128750 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.128864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.129068 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.129347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.129457 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.129675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.129974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.130083 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.130310 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.130564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.130668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.130934 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.131156 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.131247 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.131533 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.131732 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.131848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.132249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.132363 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.132473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.132849 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.132964 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.133193 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.133415 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.133508 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.133936 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.134031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.134324 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.134530 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.134635 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.134875 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.135146 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.135238 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.135512 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.135743 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.135834 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.136125 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.136317 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.136440 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.136767 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.136893 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.137182 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.137407 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.137506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.137727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.138010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.138119 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.138377 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.138730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.138895 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.138993 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.139181 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.139583 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.139680 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.139775 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.140084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.140268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.140395 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.140720 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.140818 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.141050 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.141340 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.141512 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.141649 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.141957 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.142061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.142375 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.142533 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.142637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.142959 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.143118 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.143211 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.143492 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.143696 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.143795 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.144096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.144302 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.144426 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.145080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.145208 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.145299 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.145382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.145467 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.145658 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.145960 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.146077 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.146313 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.146554 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.146646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.146928 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.147129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.147253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.147563 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.147725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.147870 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.148176 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.148267 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.148481 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.148829 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.149007 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.149135 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.149457 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.149564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.149795 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.150097 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.150204 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.150448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.150689 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.150784 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.151092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.151271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.151409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.151727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.151817 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.152055 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.152355 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.152606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.152698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.152924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.153049 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.153239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.153524 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.153624 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.153832 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.154164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.154393 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.154498 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.154760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.154897 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.155065 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.155389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.155480 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.155694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.155983 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.156085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.156319 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.156565 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.156656 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.156913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.157140 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.157233 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.157546 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.157722 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.157872 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.158205 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.158354 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.158531 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.158858 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.158962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.159178 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.159430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.159529 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.160448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.160562 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.160651 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.160957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.161115 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.161271 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.161588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.161686 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.161935 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.162241 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.162345 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.162662 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.162861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.163039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.163180 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.163497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.163607 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.163813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.164107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.164382 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.164712 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.164811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.165027 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.165305 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.165406 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.165640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.165917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.166025 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.166280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.166519 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.166622 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.166896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.167127 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.167219 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.167508 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.167724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.167823 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.168150 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.168292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.168478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.168805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.169056 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.169153 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.169405 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.169505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.169729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.170049 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.170153 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.170423 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.170620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.170726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.171037 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.171194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.171352 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.171668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.171758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.171984 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.172253 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.172383 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.172597 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.172874 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.172964 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.173214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.173474 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.173585 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.173824 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.174043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.174161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.174477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.174664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.174804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.175141 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.175374 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.175543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.176343 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.176582 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.176676 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.176967 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.177164 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.177512 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.177693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.177829 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.178186 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.178317 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.178514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.178827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.178933 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.179191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.179413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.179513 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.179768 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.179998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.180101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.180369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.180589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.180697 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.180981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.181195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.181317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.181596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.181774 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.181931 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.182238 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.182350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.182560 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.182925 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.183031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.183408 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.183533 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.183766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.184001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.184101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.184408 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.184587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.184739 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.185062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.185153 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186780 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.186933 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.187241 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.187406 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.187547 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.187860 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.188090 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.188191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.188464 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.188691 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.188782 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.189069 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.189313 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.189420 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.189691 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.189875 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.190024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.190329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.190431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.190643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.191005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.191141 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.191335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.191596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.191693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.191903 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.192173 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.192279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.192514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.192799 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.192926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.193175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.193402 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.193506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.193708 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.194019 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.194137 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.194384 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.194639 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.194736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.197496 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.197617 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.197711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.197815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.197950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198056 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198143 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198225 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198318 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198492 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198577 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198750 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198842 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.198842 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.199008 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.199093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.199093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.199093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.199606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.199701 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.199788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.199979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.201830 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.201967 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202169 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202254 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202337 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202517 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202603 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202686 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202785 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202871 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202871 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202871 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.202871 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.203479 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.203565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.203565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.203717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.203809 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.204031 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.204244 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.204337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.204555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.204857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.204957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.205166 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.205483 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.205573 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.205830 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.206093 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.206187 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.206485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.206673 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.206865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.207199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.207375 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.207539 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.207818 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.207950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.208224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.208446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.208666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.208845 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.209061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.209182 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.209481 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.209769 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.209900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.210196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.210296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.210556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.210796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.210901 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.211184 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.211400 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.211493 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.211808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.211988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.212136 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.212452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.212560 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.212774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.213079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.213195 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.213518 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.213664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.213757 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.214144 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.214251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.214429 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.214740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.214830 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.215049 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.215336 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.215426 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.215657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.215924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.216027 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.216282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.216514 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.216623 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.216883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.217195 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.217285 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.217501 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.217780 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.217920 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.218128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.218399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.218497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.218730 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.218995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.219095 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.219326 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.219633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.219940 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.220053 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.220246 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.220547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.220639 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.220856 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.221131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.221225 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.221456 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.221714 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.221814 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.222092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.222862 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.222969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.223257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.223572 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.223687 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.223899 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.223990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.224253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.224517 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.224619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.224843 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.225128 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.225227 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.225467 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.225714 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.225807 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.226123 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.226319 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.226436 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.226775 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.226929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.227088 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.227402 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.227501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.227719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.228032 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.228131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.228347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.228644 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.228736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.228978 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.229231 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.229323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.229601 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.229820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.230073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.230278 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.230457 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.230603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.230922 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.231013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.231235 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.231978 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.232089 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.232179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.232179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.232525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.232849 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.233162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.233253 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.233697 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.233812 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.233965 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.234130 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.234476 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.234606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.234758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.234938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.235090 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.235421 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.235513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.235734 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.236027 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.236126 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.236379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.236617 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.236737 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.237053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.237214 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.237399 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.237729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.237821 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.238122 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.238913 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.239009 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.239238 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.239486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:10:31.239584 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.239994 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.240868 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.241318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.241752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.242204 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.242632 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.243075 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.243743 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.244151 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.244600 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.245050 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.245488 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.245977 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.246387 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.246829 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.247250 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.247670 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.248096 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.248521 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.248955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.249394 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.249819 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.250321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.250684 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.251109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.251765 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.252398 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.252737 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.253177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.253641 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.254376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.254510 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.254943 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.255364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.255787 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.256220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.256646 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.257065 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.257482 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.257976 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.258357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.258776 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.259201 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.259631 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.260072 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.260494 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.260914 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.261331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.261756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.262196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.262613 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.263030 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.263449 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.263877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.264378 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.265018 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.265127 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.265540 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.265984 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.266465 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.266886 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.267342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.267762 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.268180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.268618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.269145 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.269611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.269964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.270295 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.270660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.270990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.271580 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.271931 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.272265 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.272618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.272962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.273283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.273600 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.273942 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.274283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.274607 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.274964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.275287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.275608 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.275930 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.278382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.278881 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.279418 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.279903 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.280402 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.281006 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.281496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.282000 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.282471 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.282949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.283330 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.283695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.284002 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.284332 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.284737 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.285688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.286480 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.286620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.286983 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.287363 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.287615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.288028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.288285 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.288891 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.289074 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.289392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.290462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.290818 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.291152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.291516 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.291837 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.292167 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.292491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.292832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.293263 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.293555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.293947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.294189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.294505 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.294817 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.295225 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.296331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.296827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.297145 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.297659 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.298013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.298331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.298648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.298959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.299270 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.299591 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.299893 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.300202 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.301131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.301441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.301757 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.302101 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.302414 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.302726 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.303037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.303367 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.303657 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.303963 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.304112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO dbcounter [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Registered counter for database nova_api Jul 28 09:10:31.304297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.304634 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.304955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.305284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.305598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.305958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.306272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.306597 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.306921 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.307243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.307581 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.307918 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.308233 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.308547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.308862 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.309175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.309488 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.309799 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.310155 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.310481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.310876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.311221 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.311526 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.311855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.312173 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.312485 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.312819 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.313129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.313441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.313756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.314141 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.314456 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.314773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.315083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.315397 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.315714 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.316032 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.316387 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.316717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.317028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.317354 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.317682 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.318127 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.318442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.318787 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.319119 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.319434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.319746 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.320369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:10:31.320562 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:10:31.324797 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_db.sqlalchemy.engines [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:10:31.331333 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writer thread running {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:10:31.381476 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO dbcounter [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Registered counter for database nova_api Jul 28 09:10:31.387202 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.context [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),16c49c6f-9465-40a7-880f-cddb465d5406(cell1) {{(pid=117864) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 09:10:31.391337 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:10:31.392848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:10:31.393646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:10:31.395756 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:10:31.397729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO dbcounter [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Registered counter for database nova_cell0 Jul 28 09:10:31.401310 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_db.sqlalchemy.engines [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:10:31.402086 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO dbcounter [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Registered counter for database nova_cell1 Jul 28 09:10:31.407947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writer thread running {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:10:31.409335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_db.sqlalchemy.engines [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:10:31.411640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_db.sqlalchemy.engines [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:10:31.417580 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writer thread running {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:10:31.419633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writer thread running {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:10:31.464182 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.context [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),16c49c6f-9465-40a7-880f-cddb465d5406(cell1) {{(pid=117863) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 09:10:31.468379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:10:31.469965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:10:31.470756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:10:31.473601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:10:31.475588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO dbcounter [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Registered counter for database nova_cell0 Jul 28 09:10:31.479588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO dbcounter [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Registered counter for database nova_cell1 Jul 28 09:10:31.486916 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_db.sqlalchemy.engines [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:10:31.489715 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_db.sqlalchemy.engines [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:10:31.494663 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writer thread running {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:10:31.497128 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writer thread running {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:10:31.564828 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO dbcounter [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Registered counter for database nova_cell0 Jul 28 09:10:31.571834 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_db.sqlalchemy.engines [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:10:31.576333 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writer thread running {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:10:31.641600 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO dbcounter [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Registered counter for database nova_cell0 Jul 28 09:10:31.649833 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_db.sqlalchemy.engines [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:10:31.654239 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writer thread running {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:10:31.898394 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: WARNING keystonemiddleware.auth_token [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:10:31.905561 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: WARNING keystonemiddleware.auth_token [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:10:31.974147 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: WARNING keystonemiddleware.auth_token [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:10:31.981411 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: WARNING keystonemiddleware.auth_token [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:10:32.247009 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: WARNING keystonemiddleware.auth_token [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:10:32.253101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: WARNING keystonemiddleware.auth_token [None req-7d6cd08b-24fd-40f6-b8d3-9d84a8724f75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:10:32.259079 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558918fb79c0 pid: 117864 (default app) Jul 28 09:10:32.322719 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: WARNING keystonemiddleware.auth_token [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:10:32.328672 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: WARNING keystonemiddleware.auth_token [None req-928a3e27-97c0-4156-b2b6-1e2bd52e9892 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:10:32.334040 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558918fb79c0 pid: 117863 (default app) Jul 28 09:11:13.435699 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:13.436804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:13.438197 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:13.444762 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:14.861766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8c44f66e-b07e-4078-b068-35ce0f28a96e tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Action: 'create', calling method: .version_select at 0x7fd6c4ebfd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-30316288"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:16.694153 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8c44f66e-b07e-4078-b068-35ce0f28a96e tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.274010 Jul 28 09:11:16.695887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jul 28 09:11:13 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3277 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 09:11:16.712765 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:16.714417 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:16.715550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:16.716812 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:17.153565 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-083595e7-2fbc-4d38-8ee6-51bc9979535f tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4e8c820>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:17.769783 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-083595e7-2fbc-4d38-8ee6-51bc9979535f tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d" status: 200 len: 343 microversion: 2.1 time: 1.061751 Jul 28 09:11:17.770459 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:11:16 2022] GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d => generated 343 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:18.784975 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-56d9fdd8-e016-4298-b0d7-9322d477a459 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d18b80>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:19.069213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-56d9fdd8-e016-4298-b0d7-9322d477a459 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d" status: 200 len: 344 microversion: 2.1 time: 0.289115 Jul 28 09:11:19.070572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:11:18 2022] GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d => generated 344 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:19.085243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1be23aa3-63be-412c-a20f-a3192a087f11 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Action: 'create', calling method: .version_select at 0x7fd6c4d52a60>, body: {"snapshot": {"volume_id": "0562e269-7504-4aa4-9804-e842fbb7823d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-136687090"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:19.478978 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1be23aa3-63be-412c-a20f-a3192a087f11 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.398814 Jul 28 09:11:19.486142 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 2/4] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jul 28 09:11:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:19.491647 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-74110004-a2b3-41da-9d34-2ed1c9a36a13 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d2c280>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:19.643994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-74110004-a2b3-41da-9d34-2ed1c9a36a13 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.156836 Jul 28 09:11:19.645390 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:19 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:19.656411 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d2d7503f-d144-4518-8b43-af53ee79ce5c tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d0f820>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:20.125354 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d2d7503f-d144-4518-8b43-af53ee79ce5c tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.472880 Jul 28 09:11:20.134327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Jul 28 09:11:19 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:20.148840 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c552b4e8-714a-448e-b21a-5a84d9874bd6 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d2c9d0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:20.272691 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c552b4e8-714a-448e-b21a-5a84d9874bd6 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.137247 Jul 28 09:11:20.273486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:20 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:11:21.287443 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-490131f1-aa4d-4ff0-8e64-021a1572f2aa tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d2aaf0>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:21.342828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-490131f1-aa4d-4ff0-8e64-021a1572f2aa tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.060751 Jul 28 09:11:21.349229 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:21 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:22.358716 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-16e9bcbf-68a6-4fa3-a7ea-5e32d35b2b69 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d18dc0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:22.419487 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-16e9bcbf-68a6-4fa3-a7ea-5e32d35b2b69 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.064475 Jul 28 09:11:22.420157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 5/9] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:22 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:23.433584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cb276943-97c9-46fe-9a45-a38e1be2ddbf tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d2cb80>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:23.494332 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1191736638", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "networks": [{"uuid": "5b2c886b-4998-465d-88a8-9d5b6629ddfc"}]}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:23.495093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cb276943-97c9-46fe-9a45-a38e1be2ddbf tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.066398 Jul 28 09:11:23.495650 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 6/10] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:23 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:11:23.709721 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] validate_networks() for [('5b2c886b-4998-465d-88a8-9d5b6629ddfc', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:11:24.507923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-05c80860-a97e-4dfd-9229-25ed395279ee tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d2c430>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:24.566668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-05c80860-a97e-4dfd-9229-25ed395279ee tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.062721 Jul 28 09:11:24.568650 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 7/11] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:24 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:25.580565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-607b8df5-c43d-40f5-9fd0-e1b0d6d7a3fc tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d380d0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:25.655917 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-607b8df5-c43d-40f5-9fd0-e1b0d6d7a3fc tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.079036 Jul 28 09:11:25.656970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 8/12] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:25 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:25.952706 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:11:25.955903 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:11:25.957918 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:11:25.958946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:11:25.960112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:11:25.992348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:25.993239 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:25.995245 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:25.998966 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:26.080263 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Getting quotas for project ba0c305435a042aabbb61816788d7c66. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:26.110663 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Getting quotas for user 816bcf956bb442e39ff9feb7e606dab4 and project ba0c305435a042aabbb61816788d7c66. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:26.148361 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:11:26.177832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:11:26.428409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1c6a8f72-daef-4dbc-9b29-71ecf65282c4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.059014 Jul 28 09:11:26.429274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 5/13] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:11:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:11:26.441707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6758b8e9-1d83-4963-b704-170e6ec1c4e6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:26.442731 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6758b8e9-1d83-4963-b704-170e6ec1c4e6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:26.670968 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ff109dfb-169e-4f5a-9c54-10fbc0cc0cd1 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c442d790>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:26.757797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ff109dfb-169e-4f5a-9c54-10fbc0cc0cd1 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 287 microversion: 2.1 time: 0.093301 Jul 28 09:11:26.764731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 6/14] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:26 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:11:26.771007 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f6190598-9364-4521-b33b-8b7e1ba50304 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c442ddc0>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:26.794117 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6758b8e9-1d83-4963-b704-170e6ec1c4e6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:26.833425 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6758b8e9-1d83-4963-b704-170e6ec1c4e6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1215 microversion: 2.1 time: 0.395639 Jul 28 09:11:26.842904 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 9/15] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:26 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1215 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:26.928217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f6190598-9364-4521-b33b-8b7e1ba50304 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 202 len: 0 microversion: 2.1 time: 0.162165 Jul 28 09:11:26.928933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 7/16] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Jul 28 09:11:26 2022] DELETE /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:11:26.949611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b914668c-b672-4d55-a047-56f14bb5cdfa tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d38f70>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:27.033240 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b914668c-b672-4d55-a047-56f14bb5cdfa tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.098877 Jul 28 09:11:27.038974 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 10/17] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:26 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:27.866510 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9e50dfc8-721f-4898-98a6-a45c13a74318 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:27.867329 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9e50dfc8-721f-4898-98a6-a45c13a74318 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:28.047350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3838498b-6ea8-428e-a568-89a76b6e1b66 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4ced940>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:28.139691 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3838498b-6ea8-428e-a568-89a76b6e1b66 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.096766 Jul 28 09:11:28.140455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 11/18] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:28 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:28.264636 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d8e1e566-dfc8-47f2-a81a-596d4e4ef97d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: .version_select at 0x7fd6c4cedf70>, body: {"keypair": {"name": "tempest-keypair-394752005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYEcPKDmWo5Na9B9gPrZOv0JhZ5C9c+ohybCsgfyxYWDYC/o8yuTzcRLc2+ymlTIWKH1Sy/x91jjOjwasJMol8odm16pNLq2M8wuZ58P/SzZv2WBoJxTtemtWMktzsFMg=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:28.343808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9e50dfc8-721f-4898-98a6-a45c13a74318 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:28.367529 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9e50dfc8-721f-4898-98a6-a45c13a74318 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1215 microversion: 2.1 time: 0.504844 Jul 28 09:11:28.379416 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 8/19] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:27 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1215 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:28.395967 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-d8e1e566-dfc8-47f2-a81a-596d4e4ef97d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for project c957cfe3391147daab9fc1e59b414a3e. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:28.408359 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-d8e1e566-dfc8-47f2-a81a-596d4e4ef97d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for user e0c1ed47784c46baa7ddc4abdfc54bbb and project c957cfe3391147daab9fc1e59b414a3e. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:28.482108 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d8e1e566-dfc8-47f2-a81a-596d4e4ef97d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.340262 Jul 28 09:11:28.483149 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 12/20] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:11:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:29.154614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-13ffbf75-b737-43e8-8549-f8b15ab10c9b tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4c4ff70>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:29.188024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-341089756", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:29.203032 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-13ffbf75-b737-43e8-8549-f8b15ab10c9b tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.053058 Jul 28 09:11:29.204252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 13/21] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:29 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:11:29.287829 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] validate_networks() for [('64888555-aa9a-41f3-b5b6-dab010021048', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:11:29.407694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b22d5cbc-4cec-4b5c-8752-006b442ce38b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:29.408339 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b22d5cbc-4cec-4b5c-8752-006b442ce38b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:29.428465 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b22d5cbc-4cec-4b5c-8752-006b442ce38b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:29.429038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b22d5cbc-4cec-4b5c-8752-006b442ce38b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:29.429944 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b22d5cbc-4cec-4b5c-8752-006b442ce38b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:29.430346 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b22d5cbc-4cec-4b5c-8752-006b442ce38b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:29.926840 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b22d5cbc-4cec-4b5c-8752-006b442ce38b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:29.946695 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b22d5cbc-4cec-4b5c-8752-006b442ce38b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1219 microversion: 2.1 time: 0.544008 Jul 28 09:11:29.950291 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 14/22] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:29 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1219 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:30.091833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ce871b7c-ca08-466f-9e0e-f556d62c5d82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'create', calling method: .version_select at 0x7fd6ca9fbd30>, body: {"keypair": {"name": "tempest-keypair-828896869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOehHpCu9CACbqrrUMLa6SonCpB/01HgaZ/1WiNCAa6YevGrrPHBbxwoAGKh5eLXMtMq7965PFDxrENd+PgEVuKEREaMthZ+OVLU2rAA/U9wGlxena5HFVebrZC3AOqEmg=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:30.132186 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-ce871b7c-ca08-466f-9e0e-f556d62c5d82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Getting quotas for project 6e862416d3ca4d019cd0dd62f439038c. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:30.140924 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-ce871b7c-ca08-466f-9e0e-f556d62c5d82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Getting quotas for user a6f5e471a7ac4218a35ffe1840d91575 and project 6e862416d3ca4d019cd0dd62f439038c. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:30.190004 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ce871b7c-ca08-466f-9e0e-f556d62c5d82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.238379 Jul 28 09:11:30.190806 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 15/23] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 09:11:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 240 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 09:11:30.332957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b99bc99f-23ec-4e63-afed-de89d2d68270 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'create', calling method: .version_select at 0x7fd6c438ddc0>, body: {"keypair": {"name": "tempest-keypair-1105039455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIyNeoDhRtQyKUsSWYK7/SuoDYGpxWN4A+V4+DuEfhYJvyBAYdm9/TM77KRYm1RXOjSrCoJ5Eti8yb/R/H52hsxfykQoJZbjeGNhvAID7gDC886Es74JlnhTuoBW4v2tA=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:30.381074 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-b99bc99f-23ec-4e63-afed-de89d2d68270 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Getting quotas for project b7b5e309462a425a92e550dd2c72ca4d. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:30.388486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-b99bc99f-23ec-4e63-afed-de89d2d68270 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Getting quotas for user 87b166b84ccd4300a1b862d375c137a5 and project b7b5e309462a425a92e550dd2c72ca4d. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:30.432712 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b99bc99f-23ec-4e63-afed-de89d2d68270 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.238904 Jul 28 09:11:30.445905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 16/24] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:11:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:30.460068 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aab024f4-58f1-453e-97ed-2140a2222476 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c43c0af0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:30.516706 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aab024f4-58f1-453e-97ed-2140a2222476 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 200 len: 286 microversion: 2.1 time: 0.068798 Jul 28 09:11:30.518424 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 17/25] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:30 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:30.828695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:11:30.828695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:11:30.829192 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:11:30.829387 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:11:30.829824 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:11:30.857812 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:30.858286 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:30.859112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:30.859545 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:30.968950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-166ace6c-a9d6-4714-b487-178f20f30bd2 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:30.969795 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-166ace6c-a9d6-4714-b487-178f20f30bd2 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:30.976152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Getting quotas for project 34cb634f5c154187a943a454a706f200. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:30.981810 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-166ace6c-a9d6-4714-b487-178f20f30bd2 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:30.987808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Getting quotas for user aff89a63c86f4e6f906988791f3c5258 and project 34cb634f5c154187a943a454a706f200. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:30.988850 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-166ace6c-a9d6-4714-b487-178f20f30bd2 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:30.989829 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-166ace6c-a9d6-4714-b487-178f20f30bd2 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:30.990420 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-166ace6c-a9d6-4714-b487-178f20f30bd2 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:31.054066 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:11:31.056303 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:11:31.249644 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-99338eec-5f17-4709-9140-7c959d215c9e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.168578 Jul 28 09:11:31.250840 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 9/26] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:11:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:11:31.283445 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f3e12749-9e04-47c2-8779-8283267bc9af tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:31.287473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f3e12749-9e04-47c2-8779-8283267bc9af tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:31.656886 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-166ace6c-a9d6-4714-b487-178f20f30bd2 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:31.668534 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-166ace6c-a9d6-4714-b487-178f20f30bd2 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1275 microversion: 2.1 time: 0.704172 Jul 28 09:11:31.687787 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 18/27] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:30 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1275 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:11:31.716998 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-37c6d8b2-90f1-415f-874b-10fd16de8afb tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c438daf0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:31.743074 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f3e12749-9e04-47c2-8779-8283267bc9af tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:31.766962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f3e12749-9e04-47c2-8779-8283267bc9af tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1221 microversion: 2.1 time: 0.500131 Jul 28 09:11:31.768643 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 10/28] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:31 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1221 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:31.803101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-37c6d8b2-90f1-415f-874b-10fd16de8afb tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] HTTP exception thrown: Snapshot beed6c37-9e00-48dd-a3f6-afa3f370f5b9 could not be found. Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-37c6d8b2-90f1-415f-874b-10fd16de8afb tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Request method failure captured: Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 HTTP/1.1 Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lKxV9ST74RLXXnS_Ln7BwXoImIN9Mlsj2qCQVKbw70IAQJB1KgeonbGjNOlyUZ7IBLLiKkur_kuAvyHTzp9Rn6vAdLcqVjix_mNs5wsDrnR2nFhxa23vKjSe2DDc7Bulqt4DXCcQ-1DlPjeKR_bFH6qvLstcwq6la4QFpZjJIzfJyw Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 17ee1d1560884281989fe65530189845 Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:11:31.808070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ee1d1560884281989fe65530189845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ee1d1560884281989fe65530189845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ee1d1560884281989fe65530189845", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ee1d1560884281989fe65530189845"}]}] Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 17ee1d1560884281989fe65530189845 Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-VolumesSnapshotsTestJSON-97895599-project Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: c5d075688fc044fcb5d89ddcd53fd71d Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-97895599-project Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Snapshot beed6c37-9e00-48dd-a3f6-afa3f370f5b9 could not be found. Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'beed6c37-9e00-48dd-a3f6-afa3f370f5b9'} Jul 28 09:11:31.809155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot beed6c37-9e00-48dd-a3f6-afa3f370f5b9 could not be found. (HTTP 404) (Request-ID: req-868fb541-047f-44c8-96d0-aff1173617f9) Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:11:31.809760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:11:31.810643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot beed6c37-9e00-48dd-a3f6-afa3f370f5b9 could not be found. Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 09:11:31.817230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot beed6c37-9e00-48dd-a3f6-afa3f370f5b9 could not be found. Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot beed6c37-9e00-48dd-a3f6-afa3f370f5b9 could not be found. Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-37c6d8b2-90f1-415f-874b-10fd16de8afb tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Returning 404 to user: Snapshot beed6c37-9e00-48dd-a3f6-afa3f370f5b9 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-37c6d8b2-90f1-415f-874b-10fd16de8afb tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9" status: 404 len: 111 microversion: 2.1 time: 0.121492 Jul 28 09:11:31.818640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 19/29] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 09:11:31 2022] GET /compute/v2.1/os-snapshots/beed6c37-9e00-48dd-a3f6-afa3f370f5b9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:11:31.819389 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bf883b97-997f-4701-99ca-d5f21656bc07 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c43f0ee0>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:31.927583 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1943830535", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:32.028140 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bf883b97-997f-4701-99ca-d5f21656bc07 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d" status: 202 len: 0 microversion: 2.1 time: 0.213481 Jul 28 09:11:32.028978 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 11/30] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:11:31 2022] DELETE /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:11:32.038417 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4bb3a110-b792-4670-b596-7b2483943a66 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c442d790>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:32.202555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] validate_networks() for [('64888555-aa9a-41f3-b5b6-dab010021048', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:11:32.417277 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-4bb3a110-b792-4670-b596-7b2483943a66 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] HTTP exception thrown: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4bb3a110-b792-4670-b596-7b2483943a66 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Request method failure captured: Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d HTTP/1.1 Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lKxV9ST74RLXXnS_Ln7BwXoImIN9Mlsj2qCQVKbw70IAQJB1KgeonbGjNOlyUZ7IBLLiKkur_kuAvyHTzp9Rn6vAdLcqVjix_mNs5wsDrnR2nFhxa23vKjSe2DDc7Bulqt4DXCcQ-1DlPjeKR_bFH6qvLstcwq6la4QFpZjJIzfJyw Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 17ee1d1560884281989fe65530189845 Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:11:32.422077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ee1d1560884281989fe65530189845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ee1d1560884281989fe65530189845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ee1d1560884281989fe65530189845", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ee1d1560884281989fe65530189845"}]}] Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 17ee1d1560884281989fe65530189845 Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesSnapshotsTestJSON-97895599-project Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: c5d075688fc044fcb5d89ddcd53fd71d Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesSnapshotsTestJSON-97895599-project Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '0562e269-7504-4aa4-9804-e842fbb7823d'} Jul 28 09:11:32.423403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. (HTTP 404) (Request-ID: req-89b347dc-5fc0-49d7-b029-289d69d9ab26) Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.436884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:11:32.438275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 09:11:32.439364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4bb3a110-b792-4670-b596-7b2483943a66 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Returning 404 to user: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4bb3a110-b792-4670-b596-7b2483943a66 tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d" status: 404 len: 109 microversion: 2.1 time: 0.390450 Jul 28 09:11:32.440391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 12/31] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:11:32 2022] GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d => generated 109 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:11:32.444100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a6a6872c-9923-4d9b-8f7d-1d4e1ee3ca1c tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c43551f0>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:32.533112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-a6a6872c-9923-4d9b-8f7d-1d4e1ee3ca1c tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] HTTP exception thrown: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a6a6872c-9923-4d9b-8f7d-1d4e1ee3ca1c tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Request method failure captured: Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: DELETE /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d HTTP/1.1 Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lKxV9ST74RLXXnS_Ln7BwXoImIN9Mlsj2qCQVKbw70IAQJB1KgeonbGjNOlyUZ7IBLLiKkur_kuAvyHTzp9Rn6vAdLcqVjix_mNs5wsDrnR2nFhxa23vKjSe2DDc7Bulqt4DXCcQ-1DlPjeKR_bFH6qvLstcwq6la4QFpZjJIzfJyw Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 17ee1d1560884281989fe65530189845 Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:11:32.536520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ee1d1560884281989fe65530189845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ee1d1560884281989fe65530189845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ee1d1560884281989fe65530189845", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ee1d1560884281989fe65530189845"}]}] Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 17ee1d1560884281989fe65530189845 Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesSnapshotsTestJSON-97895599-project Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: c5d075688fc044fcb5d89ddcd53fd71d Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesSnapshotsTestJSON-97895599-project Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '0562e269-7504-4aa4-9804-e842fbb7823d'} Jul 28 09:11:32.537615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. (HTTP 404) (Request-ID: req-113e170d-4cd3-426f-aea9-f537562bcc35) Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.539372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 09:11:32.540413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 09:11:32.541321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a6a6872c-9923-4d9b-8f7d-1d4e1ee3ca1c tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Returning 404 to user: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a6a6872c-9923-4d9b-8f7d-1d4e1ee3ca1c tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d" status: 404 len: 109 microversion: 2.1 time: 0.103209 Jul 28 09:11:32.544251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 13/32] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:11:32 2022] DELETE /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:11:32.551013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-47b46eff-b0ad-479a-b43d-fb6207b6801d tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Calling method '.version_select at 0x7fd6c4d0f940>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:32.891184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-47b46eff-b0ad-479a-b43d-fb6207b6801d tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] HTTP exception thrown: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-47b46eff-b0ad-479a-b43d-fb6207b6801d tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Request method failure captured: Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d HTTP/1.1 Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lKxV9ST74RLXXnS_Ln7BwXoImIN9Mlsj2qCQVKbw70IAQJB1KgeonbGjNOlyUZ7IBLLiKkur_kuAvyHTzp9Rn6vAdLcqVjix_mNs5wsDrnR2nFhxa23vKjSe2DDc7Bulqt4DXCcQ-1DlPjeKR_bFH6qvLstcwq6la4QFpZjJIzfJyw Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 17ee1d1560884281989fe65530189845 Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:11:32.894979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/17ee1d1560884281989fe65530189845"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ee1d1560884281989fe65530189845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_17ee1d1560884281989fe65530189845", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/17ee1d1560884281989fe65530189845"}]}] Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 17ee1d1560884281989fe65530189845 Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-97895599 Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesSnapshotsTestJSON-97895599-project Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: c5d075688fc044fcb5d89ddcd53fd71d Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesSnapshotsTestJSON-97895599-project Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '0562e269-7504-4aa4-9804-e842fbb7823d'} Jul 28 09:11:32.896041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. (HTTP 404) (Request-ID: req-be3b8fee-5050-4337-b9ac-150824041a48) Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.896652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:11:32.899724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 09:11:32.900611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-47b46eff-b0ad-479a-b43d-fb6207b6801d tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] Returning 404 to user: Volume 0562e269-7504-4aa4-9804-e842fbb7823d could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-47b46eff-b0ad-479a-b43d-fb6207b6801d tempest-VolumesSnapshotsTestJSON-97895599 tempest-VolumesSnapshotsTestJSON-97895599-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d" status: 404 len: 109 microversion: 2.1 time: 0.351195 Jul 28 09:11:32.902949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 14/33] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:11:32 2022] GET /compute/v2.1/os-volumes/0562e269-7504-4aa4-9804-e842fbb7823d => generated 109 bytes in 352 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:11:32.907482 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-551e6c70-71fa-45c9-acc0-f54341b04957 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:32.908123 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-551e6c70-71fa-45c9-acc0-f54341b04957 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:32.976269 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-551e6c70-71fa-45c9-acc0-f54341b04957 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:32.981303 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-551e6c70-71fa-45c9-acc0-f54341b04957 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:32.991105 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-551e6c70-71fa-45c9-acc0-f54341b04957 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:32.994469 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-551e6c70-71fa-45c9-acc0-f54341b04957 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:34.442713 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-551e6c70-71fa-45c9-acc0-f54341b04957 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:34.489395 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-551e6c70-71fa-45c9-acc0-f54341b04957 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1273 microversion: 2.1 time: 1.585432 Jul 28 09:11:34.494461 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 15/34] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:32 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1273 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:35.516042 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c57e4001-4ffe-4c97-a34f-495059d30aa4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:35.517488 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c57e4001-4ffe-4c97-a34f-495059d30aa4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:35.537681 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c57e4001-4ffe-4c97-a34f-495059d30aa4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:35.538342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c57e4001-4ffe-4c97-a34f-495059d30aa4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:35.548794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c57e4001-4ffe-4c97-a34f-495059d30aa4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:35.549487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c57e4001-4ffe-4c97-a34f-495059d30aa4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:36.138175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c57e4001-4ffe-4c97-a34f-495059d30aa4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:36.168255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c57e4001-4ffe-4c97-a34f-495059d30aa4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1273 microversion: 2.1 time: 0.652854 Jul 28 09:11:36.177315 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 16/35] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:35 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1273 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:36.403206 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:11:36.404847 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:11:36.405585 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:11:36.406286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:11:36.407054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:11:36.470722 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:36.473401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:36.478980 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:36.481305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:36.613694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Getting quotas for project 34cb634f5c154187a943a454a706f200. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:36.625793 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Getting quotas for user aff89a63c86f4e6f906988791f3c5258 and project 34cb634f5c154187a943a454a706f200. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:36.704857 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:11:36.708719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:11:37.029542 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9138a064-5132-4c2d-b670-390e357a4648 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.112234 Jul 28 09:11:37.030750 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 20/36] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:11:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 5115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:11:37.043340 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7580ed29-ac72-4990-8216-ce411b295c96 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:37.045109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7580ed29-ac72-4990-8216-ce411b295c96 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:37.194630 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-524e7472-c007-4bac-8999-405b300ea388 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:37.196008 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-524e7472-c007-4bac-8999-405b300ea388 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:37.214917 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-524e7472-c007-4bac-8999-405b300ea388 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:37.215411 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-524e7472-c007-4bac-8999-405b300ea388 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:37.231657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-524e7472-c007-4bac-8999-405b300ea388 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:37.232123 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-524e7472-c007-4bac-8999-405b300ea388 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:37.945597 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7580ed29-ac72-4990-8216-ce411b295c96 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:37.961404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7580ed29-ac72-4990-8216-ce411b295c96 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1222 microversion: 2.1 time: 0.922819 Jul 28 09:11:37.963912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 17/37] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:37 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1222 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:38.492858 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-217604131", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6941e6b9-7bfc-4053-9e7d-f682ee21c51f"}], "security_groups": [{"name": "tempest-securitygroup--1089297497"}], "key_name": "tempest-keypair-1105039455", "user_data": "}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:38.517228 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-524e7472-c007-4bac-8999-405b300ea388 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:38.526770 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-524e7472-c007-4bac-8999-405b300ea388 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 1.337123 Jul 28 09:11:38.538348 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 21/38] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:37 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:11:38.990525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-76c1e23d-e18e-4e6e-b8d0-2783fff2d0f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:38.991588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-76c1e23d-e18e-4e6e-b8d0-2783fff2d0f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:39.075985 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-76c1e23d-e18e-4e6e-b8d0-2783fff2d0f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:39.076783 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-76c1e23d-e18e-4e6e-b8d0-2783fff2d0f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:39.140627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-76c1e23d-e18e-4e6e-b8d0-2783fff2d0f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:39.141461 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-76c1e23d-e18e-4e6e-b8d0-2783fff2d0f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:39.702289 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-76c1e23d-e18e-4e6e-b8d0-2783fff2d0f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:39.716412 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-76c1e23d-e18e-4e6e-b8d0-2783fff2d0f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1226 microversion: 2.1 time: 0.733453 Jul 28 09:11:39.731729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] validate_networks() for [('6941e6b9-7bfc-4053-9e7d-f682ee21c51f', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:11:39.738238 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 22/39] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:38 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1226 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:39.753286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-328885c7-965f-403b-b656-8479124dd1d9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:39.759054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-328885c7-965f-403b-b656-8479124dd1d9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:39.802745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-328885c7-965f-403b-b656-8479124dd1d9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:39.802745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-328885c7-965f-403b-b656-8479124dd1d9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:39.803470 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-328885c7-965f-403b-b656-8479124dd1d9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:39.814351 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-328885c7-965f-403b-b656-8479124dd1d9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:40.893076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=4 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:42.832585 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-328885c7-965f-403b-b656-8479124dd1d9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:42.840686 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-328885c7-965f-403b-b656-8479124dd1d9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 3.101109 Jul 28 09:11:42.853864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 23/40] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:39 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:42.867915 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-575116194", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a25c70eb-0093-412d-853c-bc88149a664e"}], "security_groups": [{"name": "tempest-securitygroup--37927637"}], "key_name": "tempest-keypair-394752005", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:43.669324 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] validate_networks() for [('a25c70eb-0093-412d-853c-bc88149a664e', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:11:44.032430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:11:44.034200 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:11:44.035607 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:11:44.037653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:11:44.038236 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:11:44.052147 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:44.053013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:44.054846 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:44.055688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:44.082679 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Getting quotas for project b7b5e309462a425a92e550dd2c72ca4d. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:44.089404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Getting quotas for user 87b166b84ccd4300a1b862d375c137a5 and project b7b5e309462a425a92e550dd2c72ca4d. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:44.103791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:11:44.107694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:11:44.182913 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-df25acb9-09ea-4fda-ad3d-d55859a21649 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.697759 Jul 28 09:11:44.184434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 18/41] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:11:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 5700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 09:11:44.236732 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8646f273-e789-4cb7-860b-32fd85af9cd7 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:44.237426 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8646f273-e789-4cb7-860b-32fd85af9cd7 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:44.254181 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8646f273-e789-4cb7-860b-32fd85af9cd7 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:44.261247 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8646f273-e789-4cb7-860b-32fd85af9cd7 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:44.262360 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8646f273-e789-4cb7-860b-32fd85af9cd7 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:44.262968 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8646f273-e789-4cb7-860b-32fd85af9cd7 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:45.266338 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8646f273-e789-4cb7-860b-32fd85af9cd7 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:45.286417 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8646f273-e789-4cb7-860b-32fd85af9cd7 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 1.089901 Jul 28 09:11:45.288837 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 19/42] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:44 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:45.326922 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-388173356", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62ef4833-ede7-4ed1-81d0-684613a04084"}], "security_groups": [{"name": "tempest-securitygroup--1071165079"}], "key_name": "tempest-keypair-828896869", "user_data": "}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:45.955731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] validate_networks() for [('62ef4833-ede7-4ed1-81d0-684613a04084', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:11:46.558876 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:46.668798 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=20 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:47.240125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=9 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:47.292707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:11:47.293132 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:11:47.293602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:11:47.294028 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:11:47.294535 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:11:47.315480 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:47.316772 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:47.317819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:47.318515 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:47.379859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for project c957cfe3391147daab9fc1e59b414a3e. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:47.396758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for user e0c1ed47784c46baa7ddc4abdfc54bbb and project c957cfe3391147daab9fc1e59b414a3e. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:47.470247 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:11:47.473146 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:11:47.690573 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-11fae2a4-ffd5-4bfb-b29d-7b06f7721751 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 4.848165 Jul 28 09:11:47.695486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 24/43] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:11:42 2022] POST /compute/v2.1/servers => generated 400 bytes in 4853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:11:47.716328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-47a5d3ea-d0a5-4824-83de-0c5c22ca6159 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:47.717890 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-47a5d3ea-d0a5-4824-83de-0c5c22ca6159 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:47.736293 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47a5d3ea-d0a5-4824-83de-0c5c22ca6159 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:47.743837 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47a5d3ea-d0a5-4824-83de-0c5c22ca6159 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:47.745666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47a5d3ea-d0a5-4824-83de-0c5c22ca6159 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:47.747634 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47a5d3ea-d0a5-4824-83de-0c5c22ca6159 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.195635 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-47a5d3ea-d0a5-4824-83de-0c5c22ca6159 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:49.198142 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:11:49.198588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:11:49.199038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:11:49.199660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:11:49.200172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:11:49.208803 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=25 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:49.212280 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.212941 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.213860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.214134 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.214379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-47a5d3ea-d0a5-4824-83de-0c5c22ca6159 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 1.517559 Jul 28 09:11:49.215088 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 25/44] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:47 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:49.225369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=25 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:49.242407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Getting quotas for project 6e862416d3ca4d019cd0dd62f439038c. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:11:49.247293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Getting quotas for user a6f5e471a7ac4218a35ffe1840d91575 and project 6e862416d3ca4d019cd0dd62f439038c. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:11:49.248878 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5ac0411a-575d-452e-b77d-5acbfefaebbb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:49.249525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5ac0411a-575d-452e-b77d-5acbfefaebbb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:49.274770 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:11:49.277118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5ac0411a-575d-452e-b77d-5acbfefaebbb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.278263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5ac0411a-575d-452e-b77d-5acbfefaebbb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.279157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5ac0411a-575d-452e-b77d-5acbfefaebbb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.279599 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5ac0411a-575d-452e-b77d-5acbfefaebbb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.286723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:11:49.413219 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-04ae1dd4-a8ab-4ef5-85f5-e666534a22b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.123156 Jul 28 09:11:49.413988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 20/45] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 09:11:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 4125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 09:11:49.559506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-4ca056ab-2850-4c0d-bded-a3271778afe5 req-9630539d-ee7a-4c68-87f7-6b4957550388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc9da7bb-30df-49b1-849e-3988d86d320a", "tag": "9b0abbfa-2bf0-4a40-b6c5-74e95957cb76"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:49.582902 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-4ca056ab-2850-4c0d-bded-a3271778afe5 req-9630539d-ee7a-4c68-87f7-6b4957550388 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.583352 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-4ca056ab-2850-4c0d-bded-a3271778afe5 req-9630539d-ee7a-4c68-87f7-6b4957550388 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.626089 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-4ca056ab-2850-4c0d-bded-a3271778afe5 req-9630539d-ee7a-4c68-87f7-6b4957550388 service nova] Creating event network-changed:9b0abbfa-2bf0-4a40-b6c5-74e95957cb76 for instance fc9da7bb-30df-49b1-849e-3988d86d320a on hv-cinder-85124 Jul 28 09:11:49.626631 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-4ca056ab-2850-4c0d-bded-a3271778afe5 req-9630539d-ee7a-4c68-87f7-6b4957550388 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 09:11:49.627752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df87b997-86cf-4bfc-a918-5ceca1f349d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.628222 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df87b997-86cf-4bfc-a918-5ceca1f349d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.629020 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df87b997-86cf-4bfc-a918-5ceca1f349d8 None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.636016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df87b997-86cf-4bfc-a918-5ceca1f349d8 None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.655781 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.compute.rpcapi [None req-df87b997-86cf-4bfc-a918-5ceca1f349d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 09:11:49.659517 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df87b997-86cf-4bfc-a918-5ceca1f349d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 09:11:49.700285 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-df87b997-86cf-4bfc-a918-5ceca1f349d8 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.284914 Jul 28 09:11:49.700891 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 21/46] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:49.707028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-14e7eb83-320e-4872-a5b2-2d5208a22c6c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:49.707728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-14e7eb83-320e-4872-a5b2-2d5208a22c6c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:49.730044 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5ac0411a-575d-452e-b77d-5acbfefaebbb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:49.731997 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-14e7eb83-320e-4872-a5b2-2d5208a22c6c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.733271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-14e7eb83-320e-4872-a5b2-2d5208a22c6c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.734648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-14e7eb83-320e-4872-a5b2-2d5208a22c6c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.735107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-14e7eb83-320e-4872-a5b2-2d5208a22c6c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.743171 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5ac0411a-575d-452e-b77d-5acbfefaebbb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1295 microversion: 2.1 time: 0.504788 Jul 28 09:11:49.743808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 26/47] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:49 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1295 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:49.883245 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-24adde2c-c4ca-416f-9ec3-c922040086ba req-c4d37a86-00a7-45bf-8f61-14f8326173a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e208af-ae8f-482f-b140-66e820fb9f4c", "tag": "89af98d3-0e6d-4025-b5bf-6a18fba6c7de"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:49.930549 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-24adde2c-c4ca-416f-9ec3-c922040086ba req-c4d37a86-00a7-45bf-8f61-14f8326173a6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.931180 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-24adde2c-c4ca-416f-9ec3-c922040086ba req-c4d37a86-00a7-45bf-8f61-14f8326173a6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.981516 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-24adde2c-c4ca-416f-9ec3-c922040086ba req-c4d37a86-00a7-45bf-8f61-14f8326173a6 service nova] Creating event network-changed:89af98d3-0e6d-4025-b5bf-6a18fba6c7de for instance 25e208af-ae8f-482f-b140-66e820fb9f4c on hv-cinder-85124 Jul 28 09:11:49.982157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-24adde2c-c4ca-416f-9ec3-c922040086ba req-c4d37a86-00a7-45bf-8f61-14f8326173a6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 09:11:49.985408 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5416b60b-6ed7-4be4-8982-f93fc01bbb1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.985873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5416b60b-6ed7-4be4-8982-f93fc01bbb1e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:49.986732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5416b60b-6ed7-4be4-8982-f93fc01bbb1e None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:49.987172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5416b60b-6ed7-4be4-8982-f93fc01bbb1e None None] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:50.025322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.compute.rpcapi [None req-5416b60b-6ed7-4be4-8982-f93fc01bbb1e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 09:11:50.027635 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5416b60b-6ed7-4be4-8982-f93fc01bbb1e None None] Releasing lock "compute-rpcapi-router" {{(pid=117864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 09:11:50.053446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-14e7eb83-320e-4872-a5b2-2d5208a22c6c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:50.064548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5416b60b-6ed7-4be4-8982-f93fc01bbb1e None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310213 Jul 28 09:11:50.067271 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 27/48] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:50.074757 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-14e7eb83-320e-4872-a5b2-2d5208a22c6c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.363442 Jul 28 09:11:50.077653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 22/49] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:49 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:50.086023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0d72deec-6f15-4c9d-8fbf-c25019eb4caa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:50.087051 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0d72deec-6f15-4c9d-8fbf-c25019eb4caa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:50.095350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f0ccada0-ab7b-4748-826b-07b148b0c883 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:50.099880 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f0ccada0-ab7b-4748-826b-07b148b0c883 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:50.118602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f0ccada0-ab7b-4748-826b-07b148b0c883 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:50.120797 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f0ccada0-ab7b-4748-826b-07b148b0c883 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:50.120797 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f0ccada0-ab7b-4748-826b-07b148b0c883 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:50.120797 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f0ccada0-ab7b-4748-826b-07b148b0c883 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:50.265064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0d72deec-6f15-4c9d-8fbf-c25019eb4caa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:50.280917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0d72deec-6f15-4c9d-8fbf-c25019eb4caa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:50.285030 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0d72deec-6f15-4c9d-8fbf-c25019eb4caa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:50.286274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0d72deec-6f15-4c9d-8fbf-c25019eb4caa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1280 microversion: 2.20 time: 0.206682 Jul 28 09:11:50.288124 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 23/50] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:50 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:11:50.293101 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-456bac21-e522-42f0-86ff-e77b73e80961 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:50.293951 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-456bac21-e522-42f0-86ff-e77b73e80961 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:50.315347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f0ccada0-ab7b-4748-826b-07b148b0c883 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:50.344062 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-456bac21-e522-42f0-86ff-e77b73e80961 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:50.349159 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-456bac21-e522-42f0-86ff-e77b73e80961 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:50.356660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-456bac21-e522-42f0-86ff-e77b73e80961 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:50.360443 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-456bac21-e522-42f0-86ff-e77b73e80961 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:50.373794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f0ccada0-ab7b-4748-826b-07b148b0c883 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1244 microversion: 2.1 time: 0.282600 Jul 28 09:11:50.378846 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 28/51] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:50 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1244 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:50.702764 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-456bac21-e522-42f0-86ff-e77b73e80961 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:50.712025 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-456bac21-e522-42f0-86ff-e77b73e80961 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.422647 Jul 28 09:11:50.726354 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 24/52] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:50 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:50.774808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-496b7d68-7f33-4c26-b936-eb2f6448ee1e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:50.777288 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-496b7d68-7f33-4c26-b936-eb2f6448ee1e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:50.787159 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-496b7d68-7f33-4c26-b936-eb2f6448ee1e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:50.787949 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-496b7d68-7f33-4c26-b936-eb2f6448ee1e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:50.789263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-496b7d68-7f33-4c26-b936-eb2f6448ee1e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:50.789979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-496b7d68-7f33-4c26-b936-eb2f6448ee1e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.021607 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-496b7d68-7f33-4c26-b936-eb2f6448ee1e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:51.030730 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-496b7d68-7f33-4c26-b936-eb2f6448ee1e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.268924 Jul 28 09:11:51.046051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 29/53] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:50 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:51.107157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cc5964d2-c2fd-4243-bd88-e2dfbfc827fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:51.108418 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cc5964d2-c2fd-4243-bd88-e2dfbfc827fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:51.118617 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cc5964d2-c2fd-4243-bd88-e2dfbfc827fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:51.119466 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cc5964d2-c2fd-4243-bd88-e2dfbfc827fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.120620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cc5964d2-c2fd-4243-bd88-e2dfbfc827fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:51.121704 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cc5964d2-c2fd-4243-bd88-e2dfbfc827fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.314534 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:51.315624 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:51.318554 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cc5964d2-c2fd-4243-bd88-e2dfbfc827fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:51.323395 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:51.323855 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.324635 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:51.325081 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.326896 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cc5964d2-c2fd-4243-bd88-e2dfbfc827fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.225807 Jul 28 09:11:51.327485 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 25/54] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:51 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:51.399446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-668b44ab-071f-4ca2-8f32-1251f98c8461 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:51.400329 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-668b44ab-071f-4ca2-8f32-1251f98c8461 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:51.411910 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-668b44ab-071f-4ca2-8f32-1251f98c8461 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:51.412371 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-668b44ab-071f-4ca2-8f32-1251f98c8461 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.413206 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-668b44ab-071f-4ca2-8f32-1251f98c8461 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:51.413580 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-668b44ab-071f-4ca2-8f32-1251f98c8461 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.443666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:51.456033 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:51.471200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:51.473533 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fa7b7dde-4212-4b55-84b9-af7f65153ec3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1284 microversion: 2.20 time: 0.163290 Jul 28 09:11:51.476072 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 30/55] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:51 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:11:51.497539 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-668b44ab-071f-4ca2-8f32-1251f98c8461 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:51.505246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-668b44ab-071f-4ca2-8f32-1251f98c8461 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1236 microversion: 2.1 time: 0.110112 Jul 28 09:11:51.518035 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 26/56] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:51 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:51.733304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6e651e32-bb23-4274-a8bd-de2914bd9493 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:51.733941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6e651e32-bb23-4274-a8bd-de2914bd9493 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:51.742333 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6e651e32-bb23-4274-a8bd-de2914bd9493 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:51.743444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6e651e32-bb23-4274-a8bd-de2914bd9493 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.744372 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6e651e32-bb23-4274-a8bd-de2914bd9493 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:51.744958 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6e651e32-bb23-4274-a8bd-de2914bd9493 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:51.908642 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6e651e32-bb23-4274-a8bd-de2914bd9493 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:51.918680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6e651e32-bb23-4274-a8bd-de2914bd9493 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.188903 Jul 28 09:11:51.934993 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 31/57] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:51 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:52.059132 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-07eca741-b35e-4fdf-b042-fa512a310ab7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:52.060098 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-07eca741-b35e-4fdf-b042-fa512a310ab7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:52.067621 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07eca741-b35e-4fdf-b042-fa512a310ab7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.068300 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07eca741-b35e-4fdf-b042-fa512a310ab7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.069314 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07eca741-b35e-4fdf-b042-fa512a310ab7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.069858 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07eca741-b35e-4fdf-b042-fa512a310ab7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.135613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-6a7c3c09-ffbd-43d8-abd7-54a2bbc5aadd req-0297b33a-7a64-4083-9520-6d8779f2c109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8684b5-28bd-4cba-a505-ac85060610e3", "tag": "05fba3af-c7cc-4269-9374-da786cec1fa9"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:52.165243 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:52.188917 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-6a7c3c09-ffbd-43d8-abd7-54a2bbc5aadd req-0297b33a-7a64-4083-9520-6d8779f2c109 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.189458 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-6a7c3c09-ffbd-43d8-abd7-54a2bbc5aadd req-0297b33a-7a64-4083-9520-6d8779f2c109 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.208804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-6a7c3c09-ffbd-43d8-abd7-54a2bbc5aadd req-0297b33a-7a64-4083-9520-6d8779f2c109 service nova] Creating event network-changed:05fba3af-c7cc-4269-9374-da786cec1fa9 for instance fb8684b5-28bd-4cba-a505-ac85060610e3 on hv-cinder-85124 Jul 28 09:11:52.216147 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-6a7c3c09-ffbd-43d8-abd7-54a2bbc5aadd req-0297b33a-7a64-4083-9520-6d8779f2c109 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089480 Jul 28 09:11:52.223432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 32/58] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:11:52.256434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-07eca741-b35e-4fdf-b042-fa512a310ab7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:52.270777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-07eca741-b35e-4fdf-b042-fa512a310ab7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.220911 Jul 28 09:11:52.288293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 27/59] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:52 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:52.354409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dc6513d7-2643-44c5-9c70-ec1682df0029 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:52.355531 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dc6513d7-2643-44c5-9c70-ec1682df0029 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:52.365545 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc6513d7-2643-44c5-9c70-ec1682df0029 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.366158 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc6513d7-2643-44c5-9c70-ec1682df0029 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.367410 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc6513d7-2643-44c5-9c70-ec1682df0029 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.368259 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc6513d7-2643-44c5-9c70-ec1682df0029 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.500004 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:52.500613 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:52.525631 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.526118 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.526899 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.527337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.594142 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dc6513d7-2643-44c5-9c70-ec1682df0029 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:52.603264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dc6513d7-2643-44c5-9c70-ec1682df0029 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.254944 Jul 28 09:11:52.620038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 33/60] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:52 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:52.638997 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d65ab70f-debf-47ed-8f99-a46a6393cef7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:52.639733 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d65ab70f-debf-47ed-8f99-a46a6393cef7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:52.646366 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d65ab70f-debf-47ed-8f99-a46a6393cef7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.647950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d65ab70f-debf-47ed-8f99-a46a6393cef7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.654908 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d65ab70f-debf-47ed-8f99-a46a6393cef7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.655612 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d65ab70f-debf-47ed-8f99-a46a6393cef7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.699171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:52.712879 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:52.714825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:52.714825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f417b0bc-2186-40f2-8900-61ac26bd7343 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1284 microversion: 2.20 time: 0.218404 Jul 28 09:11:52.718135 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 28/61] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:52 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:11:52.768976 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d65ab70f-debf-47ed-8f99-a46a6393cef7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:52.776520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d65ab70f-debf-47ed-8f99-a46a6393cef7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1236 microversion: 2.1 time: 0.153354 Jul 28 09:11:52.777608 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 34/62] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:52 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1236 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:52.940463 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a92de6a1-bde5-4c26-a1f9-0a5c8d5239cb tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:52.941933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a92de6a1-bde5-4c26-a1f9-0a5c8d5239cb tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:52.948789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a92de6a1-bde5-4c26-a1f9-0a5c8d5239cb tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.949240 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a92de6a1-bde5-4c26-a1f9-0a5c8d5239cb tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:52.950055 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a92de6a1-bde5-4c26-a1f9-0a5c8d5239cb tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:52.950501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a92de6a1-bde5-4c26-a1f9-0a5c8d5239cb tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.189518 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a92de6a1-bde5-4c26-a1f9-0a5c8d5239cb tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:53.198782 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a92de6a1-bde5-4c26-a1f9-0a5c8d5239cb tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.261370 Jul 28 09:11:53.199365 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 29/63] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:52 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:53.292159 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d50ae2f-9ea5-42e5-92bf-92a24c8437ac tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:53.292857 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8d50ae2f-9ea5-42e5-92bf-92a24c8437ac tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:53.301313 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d50ae2f-9ea5-42e5-92bf-92a24c8437ac tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:53.307716 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d50ae2f-9ea5-42e5-92bf-92a24c8437ac tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.308854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d50ae2f-9ea5-42e5-92bf-92a24c8437ac tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:53.310585 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d50ae2f-9ea5-42e5-92bf-92a24c8437ac tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.611321 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d50ae2f-9ea5-42e5-92bf-92a24c8437ac tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:53.635369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-940e0746-0f81-4a91-8866-7450c53e147b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:53.638189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-940e0746-0f81-4a91-8866-7450c53e147b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:53.650682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8d50ae2f-9ea5-42e5-92bf-92a24c8437ac tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.359739 Jul 28 09:11:53.654507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 35/64] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:53 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:53.656293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-940e0746-0f81-4a91-8866-7450c53e147b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:53.657725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-940e0746-0f81-4a91-8866-7450c53e147b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.659034 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-940e0746-0f81-4a91-8866-7450c53e147b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:53.660017 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-940e0746-0f81-4a91-8866-7450c53e147b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.737281 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:53.739805 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:53.750466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:53.750913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.751720 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:53.752120 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.866786 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:53.871081 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:53.886867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:53.891710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:53.894058 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ac40b828-5526-4ff5-9f25-c935a08bd397 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1284 microversion: 2.20 time: 0.161143 Jul 28 09:11:53.907489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 36/65] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:53 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:11:53.927992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b9a2c1ae-4b71-42a5-8837-5b9823e748d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:53.929174 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b9a2c1ae-4b71-42a5-8837-5b9823e748d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:53.944921 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b9a2c1ae-4b71-42a5-8837-5b9823e748d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:53.945849 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b9a2c1ae-4b71-42a5-8837-5b9823e748d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.948631 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b9a2c1ae-4b71-42a5-8837-5b9823e748d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:53.949261 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b9a2c1ae-4b71-42a5-8837-5b9823e748d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:53.977200 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-940e0746-0f81-4a91-8866-7450c53e147b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:53.988665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-940e0746-0f81-4a91-8866-7450c53e147b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.363107 Jul 28 09:11:53.989446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 30/66] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:53 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:11:54.032983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b9a2c1ae-4b71-42a5-8837-5b9823e748d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:54.044279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b9a2c1ae-4b71-42a5-8837-5b9823e748d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1236 microversion: 2.1 time: 0.135333 Jul 28 09:11:54.045191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 37/67] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:53 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1236 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:54.111513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-6179810e-e771-4836-9c34-114c04e0c874 req-8e413891-c940-4dfc-84f2-72ff4bd612f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6936b19d-2a6d-4b60-a88f-549320d81537", "tag": "e8f10ca5-9e77-4e44-90da-226feaaaae51"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:11:54.124836 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-6179810e-e771-4836-9c34-114c04e0c874 req-8e413891-c940-4dfc-84f2-72ff4bd612f4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:54.125284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-6179810e-e771-4836-9c34-114c04e0c874 req-8e413891-c940-4dfc-84f2-72ff4bd612f4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:54.143658 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-6179810e-e771-4836-9c34-114c04e0c874 req-8e413891-c940-4dfc-84f2-72ff4bd612f4 service nova] Creating event network-changed:e8f10ca5-9e77-4e44-90da-226feaaaae51 for instance 6936b19d-2a6d-4b60-a88f-549320d81537 on hv-cinder-85124 Jul 28 09:11:54.149291 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-6179810e-e771-4836-9c34-114c04e0c874 req-8e413891-c940-4dfc-84f2-72ff4bd612f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041895 Jul 28 09:11:54.150217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 31/68] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:11:54.219619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-abdc277c-25c9-4f83-b910-6a2f254265b9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:54.220416 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-abdc277c-25c9-4f83-b910-6a2f254265b9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:54.228099 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-abdc277c-25c9-4f83-b910-6a2f254265b9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:54.228555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-abdc277c-25c9-4f83-b910-6a2f254265b9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:54.229790 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-abdc277c-25c9-4f83-b910-6a2f254265b9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:54.230252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-abdc277c-25c9-4f83-b910-6a2f254265b9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:54.432104 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-abdc277c-25c9-4f83-b910-6a2f254265b9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:54.441880 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-abdc277c-25c9-4f83-b910-6a2f254265b9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.226501 Jul 28 09:11:54.443051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 38/69] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:54 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:54.676226 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dfa2e653-fa4a-4f03-adc4-540a99d1497c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:54.677744 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dfa2e653-fa4a-4f03-adc4-540a99d1497c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:54.704708 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dfa2e653-fa4a-4f03-adc4-540a99d1497c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:54.705390 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dfa2e653-fa4a-4f03-adc4-540a99d1497c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:54.708850 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dfa2e653-fa4a-4f03-adc4-540a99d1497c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:54.723176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dfa2e653-fa4a-4f03-adc4-540a99d1497c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:54.924241 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:54.924873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:54.934485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:54.935469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:54.936644 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:54.937233 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:55.263621 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:55.281995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dfa2e653-fa4a-4f03-adc4-540a99d1497c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:55.284208 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:55.287579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:55.289239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b7ec5015-7bd3-4f43-8890-f50b33f0f412 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1276 microversion: 2.20 time: 0.370865 Jul 28 09:11:55.292011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dfa2e653-fa4a-4f03-adc4-540a99d1497c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.621736 Jul 28 09:11:55.293357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 32/70] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:54 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:55.306021 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 39/71] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:54 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1276 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:11:55.309600 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d9937861-2e30-408a-9544-6c97d4d106e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:55.310294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d9937861-2e30-408a-9544-6c97d4d106e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:55.311865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9c79acf6-13e7-43ef-b5fd-6b976acd7673 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:55.312694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9c79acf6-13e7-43ef-b5fd-6b976acd7673 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:55.319593 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d9937861-2e30-408a-9544-6c97d4d106e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:55.320049 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d9937861-2e30-408a-9544-6c97d4d106e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:55.320762 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c79acf6-13e7-43ef-b5fd-6b976acd7673 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:55.321300 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d9937861-2e30-408a-9544-6c97d4d106e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:55.321656 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d9937861-2e30-408a-9544-6c97d4d106e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:55.322404 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c79acf6-13e7-43ef-b5fd-6b976acd7673 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:55.323337 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c79acf6-13e7-43ef-b5fd-6b976acd7673 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:55.324277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c79acf6-13e7-43ef-b5fd-6b976acd7673 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:55.432973 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9c79acf6-13e7-43ef-b5fd-6b976acd7673 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:55.439889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9c79acf6-13e7-43ef-b5fd-6b976acd7673 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1292 microversion: 2.1 time: 0.132263 Jul 28 09:11:55.453636 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 40/72] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:55 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:55.466258 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2df9b85d-b9cc-48b1-a670-b07e91acecad tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:55.466867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2df9b85d-b9cc-48b1-a670-b07e91acecad tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:55.473223 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2df9b85d-b9cc-48b1-a670-b07e91acecad tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:55.473678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2df9b85d-b9cc-48b1-a670-b07e91acecad tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:55.474466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2df9b85d-b9cc-48b1-a670-b07e91acecad tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:55.474896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2df9b85d-b9cc-48b1-a670-b07e91acecad tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:55.574820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d9937861-2e30-408a-9544-6c97d4d106e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:55.582947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d9937861-2e30-408a-9544-6c97d4d106e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.288016 Jul 28 09:11:55.583536 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 33/73] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:55 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:55.673148 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2df9b85d-b9cc-48b1-a670-b07e91acecad tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:55.680971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2df9b85d-b9cc-48b1-a670-b07e91acecad tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.218760 Jul 28 09:11:55.681826 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 41/74] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:55 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:11:56.312429 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:56.317735 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d7c49884-7ca0-440b-9f52-669683a6a97e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:56.318445 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d7c49884-7ca0-440b-9f52-669683a6a97e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:56.321249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:56.324849 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7c49884-7ca0-440b-9f52-669683a6a97e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.325312 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7c49884-7ca0-440b-9f52-669683a6a97e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.326163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7c49884-7ca0-440b-9f52-669683a6a97e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.326603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7c49884-7ca0-440b-9f52-669683a6a97e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.327813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.328928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.329608 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.332016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.432175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:56.443237 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:56.444865 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:56.446057 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f0811d98-d962-4f63-ab4c-419ce60d74de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1276 microversion: 2.20 time: 0.137426 Jul 28 09:11:56.447041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 34/75] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:56 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:11:56.465102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c9b1f764-e114-4983-91e4-d37527ce0b1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:56.465744 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c9b1f764-e114-4983-91e4-d37527ce0b1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:56.473556 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c9b1f764-e114-4983-91e4-d37527ce0b1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.474072 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c9b1f764-e114-4983-91e4-d37527ce0b1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.475059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c9b1f764-e114-4983-91e4-d37527ce0b1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.475499 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c9b1f764-e114-4983-91e4-d37527ce0b1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.499706 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d7c49884-7ca0-440b-9f52-669683a6a97e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:56.507848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d7c49884-7ca0-440b-9f52-669683a6a97e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.193790 Jul 28 09:11:56.509880 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 42/76] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:56 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:56.542343 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c9b1f764-e114-4983-91e4-d37527ce0b1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:56.550109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c9b1f764-e114-4983-91e4-d37527ce0b1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1292 microversion: 2.1 time: 0.091187 Jul 28 09:11:56.555501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 35/77] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:56 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:56.605987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8688b267-84dd-4ef0-86e9-c0b9ad4fa808 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:56.607325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8688b267-84dd-4ef0-86e9-c0b9ad4fa808 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:56.615191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8688b267-84dd-4ef0-86e9-c0b9ad4fa808 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.615703 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8688b267-84dd-4ef0-86e9-c0b9ad4fa808 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.616622 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8688b267-84dd-4ef0-86e9-c0b9ad4fa808 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.617423 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8688b267-84dd-4ef0-86e9-c0b9ad4fa808 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.703938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-094b38f3-0d41-4be5-b35a-ba61ad599446 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:56.704473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-094b38f3-0d41-4be5-b35a-ba61ad599446 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:56.721214 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-094b38f3-0d41-4be5-b35a-ba61ad599446 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.721728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-094b38f3-0d41-4be5-b35a-ba61ad599446 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.722691 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-094b38f3-0d41-4be5-b35a-ba61ad599446 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:56.723202 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-094b38f3-0d41-4be5-b35a-ba61ad599446 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:56.782006 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8688b267-84dd-4ef0-86e9-c0b9ad4fa808 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:56.790135 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8688b267-84dd-4ef0-86e9-c0b9ad4fa808 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.188979 Jul 28 09:11:56.790899 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 43/78] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:56 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:56.871669 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-094b38f3-0d41-4be5-b35a-ba61ad599446 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:56.879870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-094b38f3-0d41-4be5-b35a-ba61ad599446 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.180708 Jul 28 09:11:56.880559 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 36/79] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:56 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:57.470630 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:57.471246 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:57.473616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:57.479444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.479894 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.480657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.481096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.528971 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-64f3bbcd-8334-4779-b64f-40f723a02721 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:57.529491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-64f3bbcd-8334-4779-b64f-40f723a02721 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:57.536344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64f3bbcd-8334-4779-b64f-40f723a02721 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.536804 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64f3bbcd-8334-4779-b64f-40f723a02721 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.537571 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64f3bbcd-8334-4779-b64f-40f723a02721 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.538030 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64f3bbcd-8334-4779-b64f-40f723a02721 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.544150 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:57.551995 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:57.553484 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:57.554605 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ae7d10e3-293d-47e7-a2a5-7ab8edba348b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1276 microversion: 2.20 time: 0.087844 Jul 28 09:11:57.555160 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 44/80] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:57 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:11:57.571681 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c98cc88-3eb1-439a-bc5b-d73fcf8fe181 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:57.572708 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c98cc88-3eb1-439a-bc5b-d73fcf8fe181 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:57.578790 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c98cc88-3eb1-439a-bc5b-d73fcf8fe181 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.579229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c98cc88-3eb1-439a-bc5b-d73fcf8fe181 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.579991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c98cc88-3eb1-439a-bc5b-d73fcf8fe181 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.580420 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c98cc88-3eb1-439a-bc5b-d73fcf8fe181 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.660149 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c98cc88-3eb1-439a-bc5b-d73fcf8fe181 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:57.667511 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c98cc88-3eb1-439a-bc5b-d73fcf8fe181 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1292 microversion: 2.1 time: 0.099380 Jul 28 09:11:57.668260 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 45/81] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:57 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:57.690065 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-64f3bbcd-8334-4779-b64f-40f723a02721 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:57.699073 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-64f3bbcd-8334-4779-b64f-40f723a02721 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.173461 Jul 28 09:11:57.699725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 37/82] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:57 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:11:57.810462 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b1732c68-91ee-43e9-a4a0-e6ad99a7d4fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:57.811082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b1732c68-91ee-43e9-a4a0-e6ad99a7d4fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:57.817665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1732c68-91ee-43e9-a4a0-e6ad99a7d4fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.818153 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1732c68-91ee-43e9-a4a0-e6ad99a7d4fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.818927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1732c68-91ee-43e9-a4a0-e6ad99a7d4fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.819448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1732c68-91ee-43e9-a4a0-e6ad99a7d4fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.902777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-70b7fb21-ddc8-4cba-8afc-8cedd021e68f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:57.903382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-70b7fb21-ddc8-4cba-8afc-8cedd021e68f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:57.909269 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-70b7fb21-ddc8-4cba-8afc-8cedd021e68f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.909742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-70b7fb21-ddc8-4cba-8afc-8cedd021e68f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.910607 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-70b7fb21-ddc8-4cba-8afc-8cedd021e68f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:57.911247 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-70b7fb21-ddc8-4cba-8afc-8cedd021e68f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:57.972108 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b1732c68-91ee-43e9-a4a0-e6ad99a7d4fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:57.979807 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b1732c68-91ee-43e9-a4a0-e6ad99a7d4fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.173149 Jul 28 09:11:57.980383 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 46/83] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:57 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:58.060643 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-70b7fb21-ddc8-4cba-8afc-8cedd021e68f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:58.077078 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-70b7fb21-ddc8-4cba-8afc-8cedd021e68f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.170684 Jul 28 09:11:58.077078 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 38/84] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:57 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:11:58.578218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:58.578832 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:58.585336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:58.585827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:58.586614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:58.587053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:58.653519 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:58.662176 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:58.663732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:58.664818 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0f26dd00-903a-4f07-b475-83e216e72e02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1276 microversion: 2.20 time: 0.090486 Jul 28 09:11:58.665458 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 47/85] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:58 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:11:58.688570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6841298e-1078-4e16-ac74-9951f7c8bde1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:58.689101 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6841298e-1078-4e16-ac74-9951f7c8bde1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:58.694992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6841298e-1078-4e16-ac74-9951f7c8bde1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:58.695438 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6841298e-1078-4e16-ac74-9951f7c8bde1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:58.696183 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6841298e-1078-4e16-ac74-9951f7c8bde1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:58.696616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6841298e-1078-4e16-ac74-9951f7c8bde1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:58.712293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:58.721435 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f928bded-f6a2-4e6b-adcf-9ec865e6d513 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:58.723023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f928bded-f6a2-4e6b-adcf-9ec865e6d513 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:58.729413 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f928bded-f6a2-4e6b-adcf-9ec865e6d513 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:58.730575 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f928bded-f6a2-4e6b-adcf-9ec865e6d513 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:58.731346 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f928bded-f6a2-4e6b-adcf-9ec865e6d513 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:58.731780 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f928bded-f6a2-4e6b-adcf-9ec865e6d513 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:58.759262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6841298e-1078-4e16-ac74-9951f7c8bde1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:58.766688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6841298e-1078-4e16-ac74-9951f7c8bde1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1292 microversion: 2.1 time: 0.082073 Jul 28 09:11:58.767246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 39/86] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:58 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1292 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:58.859032 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f928bded-f6a2-4e6b-adcf-9ec865e6d513 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:58.867637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f928bded-f6a2-4e6b-adcf-9ec865e6d513 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.150279 Jul 28 09:11:58.868202 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 48/87] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:58 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:11:59.001002 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-db9fd15a-b5b2-46e1-b666-a52ed899a38e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:59.001556 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-db9fd15a-b5b2-46e1-b666-a52ed899a38e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:59.008072 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-db9fd15a-b5b2-46e1-b666-a52ed899a38e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.008526 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-db9fd15a-b5b2-46e1-b666-a52ed899a38e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.009289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-db9fd15a-b5b2-46e1-b666-a52ed899a38e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.009730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-db9fd15a-b5b2-46e1-b666-a52ed899a38e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.090792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9f048acf-4084-4226-a8c1-037c74823c34 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:59.091410 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9f048acf-4084-4226-a8c1-037c74823c34 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:59.097621 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9f048acf-4084-4226-a8c1-037c74823c34 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.098101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9f048acf-4084-4226-a8c1-037c74823c34 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.098863 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9f048acf-4084-4226-a8c1-037c74823c34 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.099296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9f048acf-4084-4226-a8c1-037c74823c34 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.164747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-db9fd15a-b5b2-46e1-b666-a52ed899a38e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:59.186074 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-db9fd15a-b5b2-46e1-b666-a52ed899a38e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.188632 Jul 28 09:11:59.186591 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 40/88] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:58 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:59.247567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9f048acf-4084-4226-a8c1-037c74823c34 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:59.256691 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9f048acf-4084-4226-a8c1-037c74823c34 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.169766 Jul 28 09:11:59.257212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 49/89] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:59 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:11:59.687676 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:59.688282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:59.690579 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=6 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:59.697626 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.698109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.698880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.699321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.758643 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:59.766399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:59.767915 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:59.769000 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b3e318f1-7ca1-4de2-8269-4628950f35e9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1276 microversion: 2.20 time: 0.085757 Jul 28 09:11:59.769760 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 41/90] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:11:59 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:11:59.788478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dbb4bf07-c553-49f3-b1b5-9d4212d0084f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:59.789023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dbb4bf07-c553-49f3-b1b5-9d4212d0084f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:59.795017 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dbb4bf07-c553-49f3-b1b5-9d4212d0084f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.795459 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dbb4bf07-c553-49f3-b1b5-9d4212d0084f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.796208 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dbb4bf07-c553-49f3-b1b5-9d4212d0084f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.796639 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dbb4bf07-c553-49f3-b1b5-9d4212d0084f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.859566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dbb4bf07-c553-49f3-b1b5-9d4212d0084f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:11:59.868142 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dbb4bf07-c553-49f3-b1b5-9d4212d0084f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1292 microversion: 2.1 time: 0.083936 Jul 28 09:11:59.868686 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 50/91] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:59 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:11:59.889287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-12fa5341-5d1f-4156-b423-103092fab52e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:11:59.889923 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-12fa5341-5d1f-4156-b423-103092fab52e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:11:59.896261 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12fa5341-5d1f-4156-b423-103092fab52e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.896789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12fa5341-5d1f-4156-b423-103092fab52e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:11:59.897592 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12fa5341-5d1f-4156-b423-103092fab52e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:11:59.898059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12fa5341-5d1f-4156-b423-103092fab52e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.031258 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-12fa5341-5d1f-4156-b423-103092fab52e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:00.039301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-12fa5341-5d1f-4156-b423-103092fab52e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.154645 Jul 28 09:12:00.039805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 42/92] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:11:59 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:00.208680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-59f7e50f-715b-4b6a-96ab-da2e48284ed6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:00.209265 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-59f7e50f-715b-4b6a-96ab-da2e48284ed6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:00.211140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:00.217139 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59f7e50f-715b-4b6a-96ab-da2e48284ed6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:00.218939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59f7e50f-715b-4b6a-96ab-da2e48284ed6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.218939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59f7e50f-715b-4b6a-96ab-da2e48284ed6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:00.218939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59f7e50f-715b-4b6a-96ab-da2e48284ed6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.277237 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f179e0f6-34fc-4adf-9a60-8143b79ca72f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:00.277872 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f179e0f6-34fc-4adf-9a60-8143b79ca72f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:00.279704 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=7 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:00.285772 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f179e0f6-34fc-4adf-9a60-8143b79ca72f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:00.286257 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f179e0f6-34fc-4adf-9a60-8143b79ca72f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.287030 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f179e0f6-34fc-4adf-9a60-8143b79ca72f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:00.287469 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f179e0f6-34fc-4adf-9a60-8143b79ca72f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.418412 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-59f7e50f-715b-4b6a-96ab-da2e48284ed6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:00.426282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-59f7e50f-715b-4b6a-96ab-da2e48284ed6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.222345 Jul 28 09:12:00.426941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 51/93] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:00 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:00.449344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f179e0f6-34fc-4adf-9a60-8143b79ca72f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:00.457330 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f179e0f6-34fc-4adf-9a60-8143b79ca72f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.183307 Jul 28 09:12:00.457905 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 43/94] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:00 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:00.791440 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:00.792224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:00.799194 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:00.799669 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.800982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:00.801451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.861861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:00.870398 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:00.871884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:00.873125 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c3ae020c-c1e7-4a36-929e-ee6f38daf96a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1276 microversion: 2.20 time: 0.085717 Jul 28 09:12:00.873681 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 52/95] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:00 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:00.889489 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6941a689-d18c-42e4-8c39-d4d16aac506b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:00.890157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6941a689-d18c-42e4-8c39-d4d16aac506b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:00.896128 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6941a689-d18c-42e4-8c39-d4d16aac506b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:00.896589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6941a689-d18c-42e4-8c39-d4d16aac506b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.897344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6941a689-d18c-42e4-8c39-d4d16aac506b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:00.897785 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6941a689-d18c-42e4-8c39-d4d16aac506b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:00.958904 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6941a689-d18c-42e4-8c39-d4d16aac506b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:00.966247 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6941a689-d18c-42e4-8c39-d4d16aac506b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1292 microversion: 2.1 time: 0.081680 Jul 28 09:12:00.966813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 44/96] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:00 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1292 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:01.060891 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c799caaa-ee87-4a2a-8242-65ced4d8ab90 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:01.061549 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c799caaa-ee87-4a2a-8242-65ced4d8ab90 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:01.069105 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c799caaa-ee87-4a2a-8242-65ced4d8ab90 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:01.069723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c799caaa-ee87-4a2a-8242-65ced4d8ab90 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:01.070648 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c799caaa-ee87-4a2a-8242-65ced4d8ab90 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:01.071131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c799caaa-ee87-4a2a-8242-65ced4d8ab90 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:01.089071 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:01.206241 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c799caaa-ee87-4a2a-8242-65ced4d8ab90 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:01.213627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c799caaa-ee87-4a2a-8242-65ced4d8ab90 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.156651 Jul 28 09:12:01.214211 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 53/97] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:01 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:01.449185 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-65452b38-d751-44f7-963f-549646451f71 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:01.450109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-65452b38-d751-44f7-963f-549646451f71 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:01.464759 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-65452b38-d751-44f7-963f-549646451f71 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:01.467467 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-65452b38-d751-44f7-963f-549646451f71 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:01.468568 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-65452b38-d751-44f7-963f-549646451f71 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:01.479735 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-890d888b-becd-4900-9495-865887b090b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:01.481192 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-890d888b-becd-4900-9495-865887b090b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:01.485231 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-65452b38-d751-44f7-963f-549646451f71 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:01.498746 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-890d888b-becd-4900-9495-865887b090b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:01.499254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-890d888b-becd-4900-9495-865887b090b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:01.500072 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-890d888b-becd-4900-9495-865887b090b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:01.500505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-890d888b-becd-4900-9495-865887b090b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:02.111791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-65452b38-d751-44f7-963f-549646451f71 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:02.122012 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-65452b38-d751-44f7-963f-549646451f71 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.677513 Jul 28 09:12:02.122672 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 45/98] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:01 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:02.122794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-890d888b-becd-4900-9495-865887b090b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:02.131120 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-890d888b-becd-4900-9495-865887b090b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.655811 Jul 28 09:12:02.134579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 54/99] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:01 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:02.139083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:02.140297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:02.146305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f5db07ed-fa95-49e6-b153-c9a594c394b6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:02.146922 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f5db07ed-fa95-49e6-b153-c9a594c394b6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:02.152392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:02.152950 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:02.153244 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5db07ed-fa95-49e6-b153-c9a594c394b6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:02.153700 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5db07ed-fa95-49e6-b153-c9a594c394b6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:02.153874 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:02.154477 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:02.154579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5db07ed-fa95-49e6-b153-c9a594c394b6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:02.154918 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5db07ed-fa95-49e6-b153-c9a594c394b6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:02.233456 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:02.243748 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:02.245228 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:02.246553 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b6ad389a-42bd-4332-9336-f3944f97f375 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1332 microversion: 2.20 time: 0.120515 Jul 28 09:12:02.247249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 46/100] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:02 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:02.250878 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f5db07ed-fa95-49e6-b153-c9a594c394b6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:02.251958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8433b501-b1ce-433a-a8f0-4bd7934e6072 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:02.252614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8433b501-b1ce-433a-a8f0-4bd7934e6072 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:02.259863 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f5db07ed-fa95-49e6-b153-c9a594c394b6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1298 microversion: 2.1 time: 0.124095 Jul 28 09:12:02.260491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8433b501-b1ce-433a-a8f0-4bd7934e6072 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:02.261461 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8433b501-b1ce-433a-a8f0-4bd7934e6072 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:02.262017 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8433b501-b1ce-433a-a8f0-4bd7934e6072 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:02.263010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8433b501-b1ce-433a-a8f0-4bd7934e6072 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:02.274777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 55/101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:02 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:02.433119 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8433b501-b1ce-433a-a8f0-4bd7934e6072 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:02.443348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8433b501-b1ce-433a-a8f0-4bd7934e6072 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.194835 Jul 28 09:12:02.443951 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 47/102] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:02 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:03.145769 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ceb455d5-113e-4b59-894c-f960270389be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:03.147114 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ceb455d5-113e-4b59-894c-f960270389be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:03.154413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-55b95b2c-2061-4974-a29f-ea60c244c944 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:03.156282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-55b95b2c-2061-4974-a29f-ea60c244c944 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:03.157660 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ceb455d5-113e-4b59-894c-f960270389be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.159132 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ceb455d5-113e-4b59-894c-f960270389be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.160551 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ceb455d5-113e-4b59-894c-f960270389be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.161185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ceb455d5-113e-4b59-894c-f960270389be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.165643 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55b95b2c-2061-4974-a29f-ea60c244c944 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.166130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55b95b2c-2061-4974-a29f-ea60c244c944 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.167175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55b95b2c-2061-4974-a29f-ea60c244c944 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.167633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55b95b2c-2061-4974-a29f-ea60c244c944 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.393151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ceb455d5-113e-4b59-894c-f960270389be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:03.395940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-55b95b2c-2061-4974-a29f-ea60c244c944 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:03.403619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-55b95b2c-2061-4974-a29f-ea60c244c944 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.253605 Jul 28 09:12:03.404778 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 48/103] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:03 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:03.410401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:03.411006 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:03.415689 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ceb455d5-113e-4b59-894c-f960270389be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.264272 Jul 28 09:12:03.416777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 56/104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:03 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:03.423220 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aad3c98d-e313-4cef-ab6f-fef8983c877e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:03.424785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-aad3c98d-e313-4cef-ab6f-fef8983c877e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:03.427797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.428694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.430460 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.431426 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.434162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aad3c98d-e313-4cef-ab6f-fef8983c877e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.434620 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aad3c98d-e313-4cef-ab6f-fef8983c877e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.435725 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aad3c98d-e313-4cef-ab6f-fef8983c877e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.436307 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aad3c98d-e313-4cef-ab6f-fef8983c877e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.523703 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:03.525964 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-aad3c98d-e313-4cef-ab6f-fef8983c877e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:03.533293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:03.543967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:03.544083 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aad3c98d-e313-4cef-ab6f-fef8983c877e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1298 microversion: 2.1 time: 0.119201 Jul 28 09:12:03.544182 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-fe9a98f3-084b-41aa-8222-44a65cc6a510 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1332 microversion: 2.20 time: 0.131955 Jul 28 09:12:03.544267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 57/105] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:03 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:03.544347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 49/106] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:03 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1332 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:03.559264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4ccbb847-03b3-482d-a5c5-c7d7590fa90b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:03.560059 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4ccbb847-03b3-482d-a5c5-c7d7590fa90b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:03.567788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ccbb847-03b3-482d-a5c5-c7d7590fa90b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.568401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ccbb847-03b3-482d-a5c5-c7d7590fa90b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.569183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ccbb847-03b3-482d-a5c5-c7d7590fa90b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:03.569623 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ccbb847-03b3-482d-a5c5-c7d7590fa90b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:03.734094 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4ccbb847-03b3-482d-a5c5-c7d7590fa90b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:03.741919 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4ccbb847-03b3-482d-a5c5-c7d7590fa90b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.198162 Jul 28 09:12:03.742178 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 58/107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:03 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:04.426245 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f838e4b0-b8e9-4836-8e31-1141339196b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:04.427071 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f838e4b0-b8e9-4836-8e31-1141339196b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:04.437305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bf14b58f-905d-4ebf-b298-173e239727b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:04.438671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bf14b58f-905d-4ebf-b298-173e239727b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:04.451024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bf14b58f-905d-4ebf-b298-173e239727b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:04.451413 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bf14b58f-905d-4ebf-b298-173e239727b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:04.451638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f838e4b0-b8e9-4836-8e31-1141339196b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:04.452255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f838e4b0-b8e9-4836-8e31-1141339196b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:04.453236 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bf14b58f-905d-4ebf-b298-173e239727b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:04.454095 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f838e4b0-b8e9-4836-8e31-1141339196b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:04.454621 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bf14b58f-905d-4ebf-b298-173e239727b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:04.457458 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f838e4b0-b8e9-4836-8e31-1141339196b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:05.380370 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-bf14b58f-905d-4ebf-b298-173e239727b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:05.396652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bf14b58f-905d-4ebf-b298-173e239727b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.963888 Jul 28 09:12:05.397257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 59/108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:04 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:05.411321 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:05.411321 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:05.414897 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:05.416075 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:05.416942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:05.417540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:05.431884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f838e4b0-b8e9-4836-8e31-1141339196b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:05.441082 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f838e4b0-b8e9-4836-8e31-1141339196b4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 1.019625 Jul 28 09:12:05.441810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 50/109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:04 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:05.452399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5b4fdf09-5ebe-4258-90d6-ebd790125605 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:05.457155 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5b4fdf09-5ebe-4258-90d6-ebd790125605 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:05.470931 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5b4fdf09-5ebe-4258-90d6-ebd790125605 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:05.471396 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5b4fdf09-5ebe-4258-90d6-ebd790125605 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:05.472240 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5b4fdf09-5ebe-4258-90d6-ebd790125605 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:05.473192 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5b4fdf09-5ebe-4258-90d6-ebd790125605 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:05.539722 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:05.553960 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:05.557884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:05.559178 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fdfe81bc-b25c-402e-b3d6-ac40553b2ae8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1338 microversion: 2.20 time: 0.160845 Jul 28 09:12:05.573951 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 60/110] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:05 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1338 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:05.573951 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-85b3cba1-3532-4f1f-87d5-2e069590d765 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:05.573951 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-85b3cba1-3532-4f1f-87d5-2e069590d765 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:05.582080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85b3cba1-3532-4f1f-87d5-2e069590d765 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:05.582080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85b3cba1-3532-4f1f-87d5-2e069590d765 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:05.582080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85b3cba1-3532-4f1f-87d5-2e069590d765 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:05.582430 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85b3cba1-3532-4f1f-87d5-2e069590d765 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:05.601412 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5b4fdf09-5ebe-4258-90d6-ebd790125605 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:05.616360 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5b4fdf09-5ebe-4258-90d6-ebd790125605 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1298 microversion: 2.1 time: 0.173313 Jul 28 09:12:05.631358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 51/111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:05 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1298 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:05.846526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-85b3cba1-3532-4f1f-87d5-2e069590d765 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:05.860907 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-85b3cba1-3532-4f1f-87d5-2e069590d765 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.299331 Jul 28 09:12:05.876707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 61/112] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:05 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:06.421752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ce2051b9-d36d-464b-a587-cad3bf30fdd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:06.423081 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ce2051b9-d36d-464b-a587-cad3bf30fdd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:06.438145 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ce2051b9-d36d-464b-a587-cad3bf30fdd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:06.438723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ce2051b9-d36d-464b-a587-cad3bf30fdd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:06.439368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ce2051b9-d36d-464b-a587-cad3bf30fdd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:06.439794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ce2051b9-d36d-464b-a587-cad3bf30fdd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:06.462489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dc626cbc-57ca-4d89-8669-428e1df87922 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:06.463101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dc626cbc-57ca-4d89-8669-428e1df87922 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:06.475728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc626cbc-57ca-4d89-8669-428e1df87922 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:06.476185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc626cbc-57ca-4d89-8669-428e1df87922 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:06.476969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc626cbc-57ca-4d89-8669-428e1df87922 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:06.477406 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc626cbc-57ca-4d89-8669-428e1df87922 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:06.727312 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ce2051b9-d36d-464b-a587-cad3bf30fdd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:06.730326 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dc626cbc-57ca-4d89-8669-428e1df87922 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:06.738466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dc626cbc-57ca-4d89-8669-428e1df87922 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.279611 Jul 28 09:12:06.739362 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 62/113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:06 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:06.739875 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ce2051b9-d36d-464b-a587-cad3bf30fdd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.321677 Jul 28 09:12:06.750815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 52/114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:06 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:06.759518 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:06.760572 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:06.770824 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:06.771502 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:06.772345 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:06.772856 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:06.845408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:06.857218 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:06.859065 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:06.860175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b52260e7-5eb9-47e4-95c1-96a7f0cb040d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1338 microversion: 2.20 time: 0.108149 Jul 28 09:12:06.860712 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 53/115] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:06 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1338 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:06.865357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-61dddcb9-a2b5-4951-8e1b-941783ebe58a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:06.866143 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-61dddcb9-a2b5-4951-8e1b-941783ebe58a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:06.871938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-61dddcb9-a2b5-4951-8e1b-941783ebe58a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:06.872409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-61dddcb9-a2b5-4951-8e1b-941783ebe58a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:06.873166 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-61dddcb9-a2b5-4951-8e1b-941783ebe58a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:06.873592 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-61dddcb9-a2b5-4951-8e1b-941783ebe58a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:07.015931 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-e0f3555d-7fc5-450e-b6be-25775d070e3d req-ebe817c3-6884-4431-aa0b-f3500d0fd8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc9da7bb-30df-49b1-849e-3988d86d320a", "name": "network-vif-plugged", "status": "completed", "tag": "9b0abbfa-2bf0-4a40-b6c5-74e95957cb76"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:07.025329 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-61dddcb9-a2b5-4951-8e1b-941783ebe58a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:07.032280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-e0f3555d-7fc5-450e-b6be-25775d070e3d req-ebe817c3-6884-4431-aa0b-f3500d0fd8c5 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:07.036736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-e0f3555d-7fc5-450e-b6be-25775d070e3d req-ebe817c3-6884-4431-aa0b-f3500d0fd8c5 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:07.036984 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-61dddcb9-a2b5-4951-8e1b-941783ebe58a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.174913 Jul 28 09:12:07.037917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 54/116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:06 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:07.043612 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ac3437a1-a6ae-46ed-8f97-4484e43dc431 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:07.044232 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ac3437a1-a6ae-46ed-8f97-4484e43dc431 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:07.050872 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ac3437a1-a6ae-46ed-8f97-4484e43dc431 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:07.051510 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ac3437a1-a6ae-46ed-8f97-4484e43dc431 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:07.052424 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ac3437a1-a6ae-46ed-8f97-4484e43dc431 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:07.053001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ac3437a1-a6ae-46ed-8f97-4484e43dc431 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:07.059257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-e0f3555d-7fc5-450e-b6be-25775d070e3d req-ebe817c3-6884-4431-aa0b-f3500d0fd8c5 service nova] Creating event network-vif-plugged:9b0abbfa-2bf0-4a40-b6c5-74e95957cb76 for instance fc9da7bb-30df-49b1-849e-3988d86d320a on hv-cinder-85124 Jul 28 09:12:07.064651 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-e0f3555d-7fc5-450e-b6be-25775d070e3d req-ebe817c3-6884-4431-aa0b-f3500d0fd8c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324044 Jul 28 09:12:07.065468 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 63/117] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:07.206445 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ac3437a1-a6ae-46ed-8f97-4484e43dc431 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:07.214880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ac3437a1-a6ae-46ed-8f97-4484e43dc431 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.175940 Jul 28 09:12:07.216032 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 55/118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:07 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:07.762293 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4d8053c0-1a8d-492f-a58d-50b7853e4343 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:07.763640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4d8053c0-1a8d-492f-a58d-50b7853e4343 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:07.765196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c1fd797c-d07b-4dc2-b062-5a2a34af8158 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:07.765957 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c1fd797c-d07b-4dc2-b062-5a2a34af8158 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:07.772273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1fd797c-d07b-4dc2-b062-5a2a34af8158 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:07.772720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1fd797c-d07b-4dc2-b062-5a2a34af8158 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:07.773542 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1fd797c-d07b-4dc2-b062-5a2a34af8158 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:07.774022 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1fd797c-d07b-4dc2-b062-5a2a34af8158 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:07.774587 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4d8053c0-1a8d-492f-a58d-50b7853e4343 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:07.775240 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4d8053c0-1a8d-492f-a58d-50b7853e4343 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:07.776247 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4d8053c0-1a8d-492f-a58d-50b7853e4343 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:07.776874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4d8053c0-1a8d-492f-a58d-50b7853e4343 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:07.778318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:07.988471 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c1fd797c-d07b-4dc2-b062-5a2a34af8158 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:08.000303 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c1fd797c-d07b-4dc2-b062-5a2a34af8158 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.239658 Jul 28 09:12:08.000884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 56/119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:07 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:08.002051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4d8053c0-1a8d-492f-a58d-50b7853e4343 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:08.013065 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4d8053c0-1a8d-492f-a58d-50b7853e4343 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.256138 Jul 28 09:12:08.014591 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 64/120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:07 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:08.030399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:08.031063 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:08.038353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:08.039001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:08.039957 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:08.040570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:08.059610 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-30ecabae-6a23-4c03-b3b1-a7bb377dbca8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:08.060374 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-30ecabae-6a23-4c03-b3b1-a7bb377dbca8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:08.070622 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30ecabae-6a23-4c03-b3b1-a7bb377dbca8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:08.071077 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30ecabae-6a23-4c03-b3b1-a7bb377dbca8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:08.072273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30ecabae-6a23-4c03-b3b1-a7bb377dbca8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:08.072916 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30ecabae-6a23-4c03-b3b1-a7bb377dbca8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:08.119498 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:08.130513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:08.132060 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:08.133320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d07c1ac4-9dfc-469e-bc00-9a64cc07a420 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1338 microversion: 2.20 time: 0.119073 Jul 28 09:12:08.134390 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 57/121] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:08 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1338 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:08.232975 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-30ecabae-6a23-4c03-b3b1-a7bb377dbca8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:08.235248 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e645a92a-842d-4104-a645-61d51a068880 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:08.235861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e645a92a-842d-4104-a645-61d51a068880 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:08.241320 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-30ecabae-6a23-4c03-b3b1-a7bb377dbca8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.187333 Jul 28 09:12:08.242147 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 65/122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:08 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:08.246637 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e645a92a-842d-4104-a645-61d51a068880 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:08.247955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e645a92a-842d-4104-a645-61d51a068880 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:08.249991 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e645a92a-842d-4104-a645-61d51a068880 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:08.251509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e645a92a-842d-4104-a645-61d51a068880 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:08.416918 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e645a92a-842d-4104-a645-61d51a068880 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:08.427010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e645a92a-842d-4104-a645-61d51a068880 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.195285 Jul 28 09:12:08.428176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 58/123] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:08 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:09.020666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e59012dd-5c84-4ca6-bd90-d9275b40cad6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:09.021336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e59012dd-5c84-4ca6-bd90-d9275b40cad6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:09.029088 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e59012dd-5c84-4ca6-bd90-d9275b40cad6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.029717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e59012dd-5c84-4ca6-bd90-d9275b40cad6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.030895 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e59012dd-5c84-4ca6-bd90-d9275b40cad6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.031486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e59012dd-5c84-4ca6-bd90-d9275b40cad6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.041482 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-313f5153-65ed-448a-a187-bfce5d9c05d8 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:09.042537 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-313f5153-65ed-448a-a187-bfce5d9c05d8 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:09.054358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-313f5153-65ed-448a-a187-bfce5d9c05d8 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.054358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-313f5153-65ed-448a-a187-bfce5d9c05d8 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.054358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-313f5153-65ed-448a-a187-bfce5d9c05d8 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.054358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-313f5153-65ed-448a-a187-bfce5d9c05d8 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.334988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e59012dd-5c84-4ca6-bd90-d9275b40cad6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:09.335357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-313f5153-65ed-448a-a187-bfce5d9c05d8 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:09.344576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e59012dd-5c84-4ca6-bd90-d9275b40cad6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.327780 Jul 28 09:12:09.345680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 66/124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:09 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:09.346901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-313f5153-65ed-448a-a187-bfce5d9c05d8 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.312660 Jul 28 09:12:09.360477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:09.360477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:09.360477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.360477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.360920 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.360920 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.361575 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 59/125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:09 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:09.366925 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5a47ed3c-8cac-449d-8981-33fafd44a0fb tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:09.367524 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5a47ed3c-8cac-449d-8981-33fafd44a0fb tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:09.374251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5a47ed3c-8cac-449d-8981-33fafd44a0fb tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.375058 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5a47ed3c-8cac-449d-8981-33fafd44a0fb tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.376320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5a47ed3c-8cac-449d-8981-33fafd44a0fb tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.377359 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5a47ed3c-8cac-449d-8981-33fafd44a0fb tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.436023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:09.445070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:09.446699 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:09.448086 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f7997244-d732-4ff9-8a3a-cc0e09accd1d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1338 microversion: 2.20 time: 0.101403 Jul 28 09:12:09.448644 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 67/126] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:09 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:09.453606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6663f2e3-909c-43bd-9151-4c5d969e63ec tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:09.456873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6663f2e3-909c-43bd-9151-4c5d969e63ec tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:09.463649 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6663f2e3-909c-43bd-9151-4c5d969e63ec tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.464284 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6663f2e3-909c-43bd-9151-4c5d969e63ec tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.465068 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6663f2e3-909c-43bd-9151-4c5d969e63ec tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:09.465507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6663f2e3-909c-43bd-9151-4c5d969e63ec tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:09.617812 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5a47ed3c-8cac-449d-8981-33fafd44a0fb tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:09.628410 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5a47ed3c-8cac-449d-8981-33fafd44a0fb tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.265386 Jul 28 09:12:09.629301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 60/127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:09 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:09.666275 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6663f2e3-909c-43bd-9151-4c5d969e63ec tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:09.674875 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6663f2e3-909c-43bd-9151-4c5d969e63ec tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.225223 Jul 28 09:12:09.676013 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 68/128] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:09 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:10.367188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dbb58168-1e46-4975-8a83-7d25514f2c79 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:10.367807 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dbb58168-1e46-4975-8a83-7d25514f2c79 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:10.368435 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c8acab4-5a9f-4d15-8167-5adf4076f237 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:10.369051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c8acab4-5a9f-4d15-8167-5adf4076f237 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:10.373827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dbb58168-1e46-4975-8a83-7d25514f2c79 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.374312 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dbb58168-1e46-4975-8a83-7d25514f2c79 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.375079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dbb58168-1e46-4975-8a83-7d25514f2c79 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.375264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c8acab4-5a9f-4d15-8167-5adf4076f237 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.375693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dbb58168-1e46-4975-8a83-7d25514f2c79 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.376055 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c8acab4-5a9f-4d15-8167-5adf4076f237 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.376831 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c8acab4-5a9f-4d15-8167-5adf4076f237 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.377273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c8acab4-5a9f-4d15-8167-5adf4076f237 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.577437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dbb58168-1e46-4975-8a83-7d25514f2c79 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:10.581112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c8acab4-5a9f-4d15-8167-5adf4076f237 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:10.585593 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dbb58168-1e46-4975-8a83-7d25514f2c79 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.223317 Jul 28 09:12:10.586199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 61/129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:10 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:10.591326 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:10.592131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:10.594024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c8acab4-5a9f-4d15-8167-5adf4076f237 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.228981 Jul 28 09:12:10.594963 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 69/130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:10 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:10.596768 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:10.599381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.599830 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.600590 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.601027 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.650330 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-58ea8011-a4d0-419d-8ab3-3ccb7d23cb6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:10.651038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-58ea8011-a4d0-419d-8ab3-3ccb7d23cb6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:10.658344 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58ea8011-a4d0-419d-8ab3-3ccb7d23cb6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.659007 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58ea8011-a4d0-419d-8ab3-3ccb7d23cb6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.660633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58ea8011-a4d0-419d-8ab3-3ccb7d23cb6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.661270 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58ea8011-a4d0-419d-8ab3-3ccb7d23cb6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.673160 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:10.685404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:10.687289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:10.689045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dcf7585a-1e7a-4385-a098-fd51c6bc4428 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1338 microversion: 2.20 time: 0.101664 Jul 28 09:12:10.702045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 62/131] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:10 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:10.704188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3a2aac3c-7cae-4d85-b106-56ba029e1341 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:10.704188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3a2aac3c-7cae-4d85-b106-56ba029e1341 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:10.710695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3a2aac3c-7cae-4d85-b106-56ba029e1341 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.711138 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3a2aac3c-7cae-4d85-b106-56ba029e1341 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.711897 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3a2aac3c-7cae-4d85-b106-56ba029e1341 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:10.712331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3a2aac3c-7cae-4d85-b106-56ba029e1341 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:10.899972 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3a2aac3c-7cae-4d85-b106-56ba029e1341 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:10.900183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-58ea8011-a4d0-419d-8ab3-3ccb7d23cb6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:10.905026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:10.908484 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3a2aac3c-7cae-4d85-b106-56ba029e1341 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.208750 Jul 28 09:12:10.909055 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 63/132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:10 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:10.909671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-58ea8011-a4d0-419d-8ab3-3ccb7d23cb6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.263220 Jul 28 09:12:10.910442 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 70/133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:10 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:11.609802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-39137183-02fe-4cff-b362-72a7db9d1dd8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:11.611028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-39137183-02fe-4cff-b362-72a7db9d1dd8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:11.617230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-85ed9df8-ae01-4de2-9d07-b2fdc261e789 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:11.618757 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-85ed9df8-ae01-4de2-9d07-b2fdc261e789 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:11.619616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39137183-02fe-4cff-b362-72a7db9d1dd8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:11.620070 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39137183-02fe-4cff-b362-72a7db9d1dd8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:11.621177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39137183-02fe-4cff-b362-72a7db9d1dd8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:11.621620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39137183-02fe-4cff-b362-72a7db9d1dd8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:11.627429 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85ed9df8-ae01-4de2-9d07-b2fdc261e789 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:11.627952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85ed9df8-ae01-4de2-9d07-b2fdc261e789 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:11.629108 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85ed9df8-ae01-4de2-9d07-b2fdc261e789 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:11.629750 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85ed9df8-ae01-4de2-9d07-b2fdc261e789 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:12.114158 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-85ed9df8-ae01-4de2-9d07-b2fdc261e789 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:12.121678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-85ed9df8-ae01-4de2-9d07-b2fdc261e789 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.510248 Jul 28 09:12:12.122367 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 71/134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:11 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:12.126763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:12.127355 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:12.133015 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:12.133452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:12.134239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:12.134667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:12.154890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-39137183-02fe-4cff-b362-72a7db9d1dd8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:12.163866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-39137183-02fe-4cff-b362-72a7db9d1dd8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.560834 Jul 28 09:12:12.164444 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 64/135] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:11 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:12.169946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a0ab648b-37ed-4c6f-852a-7331e525362c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:12.170772 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a0ab648b-37ed-4c6f-852a-7331e525362c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:12.178990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a0ab648b-37ed-4c6f-852a-7331e525362c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:12.178990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a0ab648b-37ed-4c6f-852a-7331e525362c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:12.179508 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a0ab648b-37ed-4c6f-852a-7331e525362c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:12.179942 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a0ab648b-37ed-4c6f-852a-7331e525362c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:12.250536 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:12.258872 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:12.260503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:12.261883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-58747ad9-9e34-4448-babf-dbf8487e9506 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1338 microversion: 2.20 time: 0.138588 Jul 28 09:12:12.262461 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 72/136] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:12 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1338 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:12.267353 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-97866b6c-579a-4cf0-83e9-6a028904d4cf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:12.268043 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-97866b6c-579a-4cf0-83e9-6a028904d4cf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:12.274853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97866b6c-579a-4cf0-83e9-6a028904d4cf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:12.275437 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97866b6c-579a-4cf0-83e9-6a028904d4cf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:12.276304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97866b6c-579a-4cf0-83e9-6a028904d4cf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:12.276740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97866b6c-579a-4cf0-83e9-6a028904d4cf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:12.624056 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a0ab648b-37ed-4c6f-852a-7331e525362c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:12.649524 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a0ab648b-37ed-4c6f-852a-7331e525362c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.483806 Jul 28 09:12:12.650329 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 65/137] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:12 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:12.723257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-97866b6c-579a-4cf0-83e9-6a028904d4cf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:12.731827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-97866b6c-579a-4cf0-83e9-6a028904d4cf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.467845 Jul 28 09:12:12.732525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 73/138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:12 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:13.144207 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-58ccbb69-5f5f-4580-b3d2-ae8f69dc726f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:13.145148 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-58ccbb69-5f5f-4580-b3d2-ae8f69dc726f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:13.157369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-58ccbb69-5f5f-4580-b3d2-ae8f69dc726f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.158531 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-58ccbb69-5f5f-4580-b3d2-ae8f69dc726f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:13.160217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-58ccbb69-5f5f-4580-b3d2-ae8f69dc726f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.160801 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-58ccbb69-5f5f-4580-b3d2-ae8f69dc726f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:13.187496 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1d5b6ff1-4c90-43c9-9319-7e110c598934 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:13.188121 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1d5b6ff1-4c90-43c9-9319-7e110c598934 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:13.201871 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d5b6ff1-4c90-43c9-9319-7e110c598934 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.203875 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d5b6ff1-4c90-43c9-9319-7e110c598934 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:13.205512 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d5b6ff1-4c90-43c9-9319-7e110c598934 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.207610 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d5b6ff1-4c90-43c9-9319-7e110c598934 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:13.556277 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-58ccbb69-5f5f-4580-b3d2-ae8f69dc726f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:13.568609 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-58ccbb69-5f5f-4580-b3d2-ae8f69dc726f tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.429032 Jul 28 09:12:13.569457 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 66/139] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:13 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:13.570555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1d5b6ff1-4c90-43c9-9319-7e110c598934 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:13.577707 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:13.578720 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1d5b6ff1-4c90-43c9-9319-7e110c598934 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.396280 Jul 28 09:12:13.578849 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:13.586809 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.587572 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:13.588730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.589509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:13.592331 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 74/140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:13 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:13.598298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-3aec0459-5325-4002-b838-577afea28ed2 req-b4cdc3a8-f9a4-4c09-9064-78ee8158d1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bbe522-65b1-4925-9da8-8691bb25acdc", "tag": "083e115f-7d9f-46a4-a9c2-332b4c7553c4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:13.610102 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-3aec0459-5325-4002-b838-577afea28ed2 req-b4cdc3a8-f9a4-4c09-9064-78ee8158d1d8 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.610800 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-3aec0459-5325-4002-b838-577afea28ed2 req-b4cdc3a8-f9a4-4c09-9064-78ee8158d1d8 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:13.625454 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-3aec0459-5325-4002-b838-577afea28ed2 req-b4cdc3a8-f9a4-4c09-9064-78ee8158d1d8 service nova] Creating event network-changed:083e115f-7d9f-46a4-a9c2-332b4c7553c4 for instance a8bbe522-65b1-4925-9da8-8691bb25acdc on hv-cinder-85124 Jul 28 09:12:13.643752 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-3aec0459-5325-4002-b838-577afea28ed2 req-b4cdc3a8-f9a4-4c09-9064-78ee8158d1d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044540 Jul 28 09:12:13.645416 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 75/141] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:13.678407 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-237ba3d9-bc72-4123-b56f-4a102d874116 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:13.680873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-237ba3d9-bc72-4123-b56f-4a102d874116 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:13.692556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-237ba3d9-bc72-4123-b56f-4a102d874116 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.693026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-237ba3d9-bc72-4123-b56f-4a102d874116 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:13.693820 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-237ba3d9-bc72-4123-b56f-4a102d874116 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:13.694427 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-237ba3d9-bc72-4123-b56f-4a102d874116 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:14.054967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:14.064695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:14.067133 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:14.068253 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-12bfa89c-47ef-49bd-958f-fe48c03cf26f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.497614 Jul 28 09:12:14.068808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 67/142] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:13 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:14.082610 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cf12f95c-effa-48df-93cd-7774315dc408 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:14.083614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cf12f95c-effa-48df-93cd-7774315dc408 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:14.090676 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf12f95c-effa-48df-93cd-7774315dc408 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:14.091223 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf12f95c-effa-48df-93cd-7774315dc408 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:14.092139 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf12f95c-effa-48df-93cd-7774315dc408 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:14.092646 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf12f95c-effa-48df-93cd-7774315dc408 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:14.108859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-237ba3d9-bc72-4123-b56f-4a102d874116 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:14.121151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-237ba3d9-bc72-4123-b56f-4a102d874116 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.453054 Jul 28 09:12:14.123979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 76/143] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:13 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:14.333810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cf12f95c-effa-48df-93cd-7774315dc408 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:14.341826 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cf12f95c-effa-48df-93cd-7774315dc408 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.271794 Jul 28 09:12:14.342466 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 68/144] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:14 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:14.591044 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9f631c99-2a72-4606-a7d4-e7c665ceb39b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:14.591583 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9f631c99-2a72-4606-a7d4-e7c665ceb39b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:14.598556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9f631c99-2a72-4606-a7d4-e7c665ceb39b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:14.599009 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9f631c99-2a72-4606-a7d4-e7c665ceb39b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:14.599342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5f1388ab-ee53-4e7d-91ed-18a3ae7bd9b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:14.599779 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9f631c99-2a72-4606-a7d4-e7c665ceb39b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:14.599951 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5f1388ab-ee53-4e7d-91ed-18a3ae7bd9b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:14.600217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9f631c99-2a72-4606-a7d4-e7c665ceb39b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:14.607339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f1388ab-ee53-4e7d-91ed-18a3ae7bd9b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:14.607661 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f1388ab-ee53-4e7d-91ed-18a3ae7bd9b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:14.608668 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f1388ab-ee53-4e7d-91ed-18a3ae7bd9b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:14.609180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f1388ab-ee53-4e7d-91ed-18a3ae7bd9b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:14.809014 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9f631c99-2a72-4606-a7d4-e7c665ceb39b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:14.812322 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5f1388ab-ee53-4e7d-91ed-18a3ae7bd9b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:14.817813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9f631c99-2a72-4606-a7d4-e7c665ceb39b tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.230498 Jul 28 09:12:14.821499 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5f1388ab-ee53-4e7d-91ed-18a3ae7bd9b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.226495 Jul 28 09:12:14.832305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 77/145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:14 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:14.834113 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 69/146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:14 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:15.091596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:15.092199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:15.098222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.098669 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.099432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.099866 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.143129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9c25c7c7-4918-412a-9624-d297386af8c7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:15.143933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9c25c7c7-4918-412a-9624-d297386af8c7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:15.149862 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9c25c7c7-4918-412a-9624-d297386af8c7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.150316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9c25c7c7-4918-412a-9624-d297386af8c7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.151074 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9c25c7c7-4918-412a-9624-d297386af8c7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.151527 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9c25c7c7-4918-412a-9624-d297386af8c7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.284665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:15.292629 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:15.294251 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:15.295352 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b51552b0-1504-4b6c-b5d1-1bdb73d6ab03 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.207669 Jul 28 09:12:15.295913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 78/147] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:15 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:15.313187 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9c25c7c7-4918-412a-9624-d297386af8c7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:15.321372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9c25c7c7-4918-412a-9624-d297386af8c7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.182197 Jul 28 09:12:15.321977 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 70/148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:15 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:15.364385 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-74ff5a38-83fe-42a2-ab2a-5aad1e9731d9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:15.365000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-74ff5a38-83fe-42a2-ab2a-5aad1e9731d9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:15.371673 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74ff5a38-83fe-42a2-ab2a-5aad1e9731d9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.372131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74ff5a38-83fe-42a2-ab2a-5aad1e9731d9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.372910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74ff5a38-83fe-42a2-ab2a-5aad1e9731d9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.373346 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74ff5a38-83fe-42a2-ab2a-5aad1e9731d9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.510685 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-990e0e05-0b73-4838-a495-fad90529a480 req-661fc867-38ef-4441-b666-4badf6d7f0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e208af-ae8f-482f-b140-66e820fb9f4c", "name": "network-vif-plugged", "status": "completed", "tag": "89af98d3-0e6d-4025-b5bf-6a18fba6c7de"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:15.525660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-990e0e05-0b73-4838-a495-fad90529a480 req-661fc867-38ef-4441-b666-4badf6d7f0d4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.526639 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-990e0e05-0b73-4838-a495-fad90529a480 req-661fc867-38ef-4441-b666-4badf6d7f0d4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.547659 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-990e0e05-0b73-4838-a495-fad90529a480 req-661fc867-38ef-4441-b666-4badf6d7f0d4 service nova] Creating event network-vif-plugged:89af98d3-0e6d-4025-b5bf-6a18fba6c7de for instance 25e208af-ae8f-482f-b140-66e820fb9f4c on hv-cinder-85124 Jul 28 09:12:15.554042 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-990e0e05-0b73-4838-a495-fad90529a480 req-661fc867-38ef-4441-b666-4badf6d7f0d4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049054 Jul 28 09:12:15.554731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 71/149] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:15.682186 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-74ff5a38-83fe-42a2-ab2a-5aad1e9731d9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:15.691508 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-74ff5a38-83fe-42a2-ab2a-5aad1e9731d9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.331012 Jul 28 09:12:15.692096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 79/150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:15 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:15.839498 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-78a69fc8-3619-4843-9169-4f0f297dfe04 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:15.840358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-78a69fc8-3619-4843-9169-4f0f297dfe04 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:15.843455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8b0e1167-830c-458e-91f3-23bc66590a9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:15.844364 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8b0e1167-830c-458e-91f3-23bc66590a9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:15.846952 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-78a69fc8-3619-4843-9169-4f0f297dfe04 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.847481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-78a69fc8-3619-4843-9169-4f0f297dfe04 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.848333 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-78a69fc8-3619-4843-9169-4f0f297dfe04 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.848841 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-78a69fc8-3619-4843-9169-4f0f297dfe04 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.851634 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8b0e1167-830c-458e-91f3-23bc66590a9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.852102 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8b0e1167-830c-458e-91f3-23bc66590a9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:15.852872 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8b0e1167-830c-458e-91f3-23bc66590a9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:15.853476 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8b0e1167-830c-458e-91f3-23bc66590a9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:16.158726 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-78a69fc8-3619-4843-9169-4f0f297dfe04 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:16.167172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-78a69fc8-3619-4843-9169-4f0f297dfe04 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.332004 Jul 28 09:12:16.167755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 72/151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:15 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:16.173988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8b0e1167-830c-458e-91f3-23bc66590a9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:16.182218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8b0e1167-830c-458e-91f3-23bc66590a9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.343024 Jul 28 09:12:16.182778 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 80/152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:15 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:16.318928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:16.319962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:16.326621 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:16.327291 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:16.328061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:16.328522 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:16.342588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-813e5d64-e688-4082-a73f-7bbe193db28a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:16.343191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-813e5d64-e688-4082-a73f-7bbe193db28a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:16.359600 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-813e5d64-e688-4082-a73f-7bbe193db28a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:16.360100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-813e5d64-e688-4082-a73f-7bbe193db28a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:16.360804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-813e5d64-e688-4082-a73f-7bbe193db28a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:16.361236 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-813e5d64-e688-4082-a73f-7bbe193db28a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:16.366385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:16.593327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:16.605429 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:16.605570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-813e5d64-e688-4082-a73f-7bbe193db28a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:16.607279 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:16.608516 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8264ed47-742b-4ca9-a1b9-1df7ce0c9a74 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.293726 Jul 28 09:12:16.609150 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 73/153] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:16 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:16.613313 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-813e5d64-e688-4082-a73f-7bbe193db28a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.274791 Jul 28 09:12:16.613889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 81/154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:16 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:16.614504 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-8c9ef442-3097-496c-9a5f-c57a830c27fd req-2cbb6e5b-3997-4acf-bfa2-d62bd52f1434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145d502e-eb34-435a-8b8c-2ea6264d1506", "tag": "51927101-a0e7-4577-83b1-566bb606eeb1"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:16.624168 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-8c9ef442-3097-496c-9a5f-c57a830c27fd req-2cbb6e5b-3997-4acf-bfa2-d62bd52f1434 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:16.624679 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-8c9ef442-3097-496c-9a5f-c57a830c27fd req-2cbb6e5b-3997-4acf-bfa2-d62bd52f1434 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:16.639062 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-8c9ef442-3097-496c-9a5f-c57a830c27fd req-2cbb6e5b-3997-4acf-bfa2-d62bd52f1434 service nova] Creating event network-changed:51927101-a0e7-4577-83b1-566bb606eeb1 for instance 145d502e-eb34-435a-8b8c-2ea6264d1506 on hv-cinder-85124 Jul 28 09:12:16.644619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-8c9ef442-3097-496c-9a5f-c57a830c27fd req-2cbb6e5b-3997-4acf-bfa2-d62bd52f1434 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033607 Jul 28 09:12:16.645216 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 74/155] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:16.715138 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b5f41347-fc96-49f5-99cd-cef7fe3bb264 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:16.715825 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b5f41347-fc96-49f5-99cd-cef7fe3bb264 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:16.719136 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:16.724100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b5f41347-fc96-49f5-99cd-cef7fe3bb264 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:16.724873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b5f41347-fc96-49f5-99cd-cef7fe3bb264 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:16.726156 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b5f41347-fc96-49f5-99cd-cef7fe3bb264 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:16.726678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b5f41347-fc96-49f5-99cd-cef7fe3bb264 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:16.861372 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b5f41347-fc96-49f5-99cd-cef7fe3bb264 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:16.868933 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b5f41347-fc96-49f5-99cd-cef7fe3bb264 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.158712 Jul 28 09:12:16.869495 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 82/156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:16 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:17.189267 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-37f1bf46-b7ec-4ba4-9f50-3c35644cad74 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:17.190079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-37f1bf46-b7ec-4ba4-9f50-3c35644cad74 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:17.198797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37f1bf46-b7ec-4ba4-9f50-3c35644cad74 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.198797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37f1bf46-b7ec-4ba4-9f50-3c35644cad74 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.198797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37f1bf46-b7ec-4ba4-9f50-3c35644cad74 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.203945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fb23d36c-abba-47bb-8ed0-16185b5ec133 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:17.204616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fb23d36c-abba-47bb-8ed0-16185b5ec133 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:17.208047 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37f1bf46-b7ec-4ba4-9f50-3c35644cad74 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.211562 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb23d36c-abba-47bb-8ed0-16185b5ec133 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.212193 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb23d36c-abba-47bb-8ed0-16185b5ec133 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.212942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb23d36c-abba-47bb-8ed0-16185b5ec133 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.213453 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb23d36c-abba-47bb-8ed0-16185b5ec133 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.437144 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-37f1bf46-b7ec-4ba4-9f50-3c35644cad74 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:17.442509 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fb23d36c-abba-47bb-8ed0-16185b5ec133 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:17.445383 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-37f1bf46-b7ec-4ba4-9f50-3c35644cad74 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.260694 Jul 28 09:12:17.445981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 75/157] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:17 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:17.450397 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fb23d36c-abba-47bb-8ed0-16185b5ec133 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.250330 Jul 28 09:12:17.450982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 83/158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:17 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:17.632504 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:17.633279 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:17.634632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-22a973bb-d839-449f-bdfd-6265b13b550d tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:17.635267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-22a973bb-d839-449f-bdfd-6265b13b550d tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:17.639828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.640266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.641012 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.641113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22a973bb-d839-449f-bdfd-6265b13b550d tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.641437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.641529 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22a973bb-d839-449f-bdfd-6265b13b550d tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.642305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22a973bb-d839-449f-bdfd-6265b13b550d tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.642736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22a973bb-d839-449f-bdfd-6265b13b550d tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.838749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:17.841645 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-22a973bb-d839-449f-bdfd-6265b13b550d tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:17.846946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:17.849883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-22a973bb-d839-449f-bdfd-6265b13b550d tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.219560 Jul 28 09:12:17.850246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:17.850445 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 84/159] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:17 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:17.851357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f686a2d2-3361-4848-b5a9-cde281304b02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.224102 Jul 28 09:12:17.851899 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 76/160] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:17 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:17.889401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3f3aabab-6d8d-4a7b-9537-a9ceb0d5cf1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:17.889974 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3f3aabab-6d8d-4a7b-9537-a9ceb0d5cf1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:17.896542 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f3aabab-6d8d-4a7b-9537-a9ceb0d5cf1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.896994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f3aabab-6d8d-4a7b-9537-a9ceb0d5cf1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:17.897744 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f3aabab-6d8d-4a7b-9537-a9ceb0d5cf1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:17.898237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f3aabab-6d8d-4a7b-9537-a9ceb0d5cf1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:18.027589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3f3aabab-6d8d-4a7b-9537-a9ceb0d5cf1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:18.034900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3f3aabab-6d8d-4a7b-9537-a9ceb0d5cf1e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.149215 Jul 28 09:12:18.035462 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 85/161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:17 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:18.465974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7b471b15-2148-41bc-87b0-a7cd7cda18e1 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:18.466762 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7b471b15-2148-41bc-87b0-a7cd7cda18e1 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:18.470568 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dfa1a7f5-fef6-4862-ab33-f676fe4002fb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:18.471179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dfa1a7f5-fef6-4862-ab33-f676fe4002fb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:18.473474 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7b471b15-2148-41bc-87b0-a7cd7cda18e1 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:18.474054 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7b471b15-2148-41bc-87b0-a7cd7cda18e1 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:18.474910 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7b471b15-2148-41bc-87b0-a7cd7cda18e1 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:18.475429 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7b471b15-2148-41bc-87b0-a7cd7cda18e1 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:18.477506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dfa1a7f5-fef6-4862-ab33-f676fe4002fb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:18.477995 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dfa1a7f5-fef6-4862-ab33-f676fe4002fb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:18.478753 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dfa1a7f5-fef6-4862-ab33-f676fe4002fb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:18.479194 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dfa1a7f5-fef6-4862-ab33-f676fe4002fb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:18.666826 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7b471b15-2148-41bc-87b0-a7cd7cda18e1 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:18.669970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dfa1a7f5-fef6-4862-ab33-f676fe4002fb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:18.674180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7b471b15-2148-41bc-87b0-a7cd7cda18e1 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.211981 Jul 28 09:12:18.674749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 77/162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:18 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:18.678132 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dfa1a7f5-fef6-4862-ab33-f676fe4002fb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.211267 Jul 28 09:12:18.678682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 86/163] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:18 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:18.870809 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a8b696d3-5ef1-49b4-be27-adff5d7f7cc6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:18.871407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a8b696d3-5ef1-49b4-be27-adff5d7f7cc6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:18.873347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:18.873982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:18.877585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a8b696d3-5ef1-49b4-be27-adff5d7f7cc6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:18.878063 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a8b696d3-5ef1-49b4-be27-adff5d7f7cc6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:18.879309 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a8b696d3-5ef1-49b4-be27-adff5d7f7cc6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:18.879744 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a8b696d3-5ef1-49b4-be27-adff5d7f7cc6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:18.880006 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:18.880456 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:18.881210 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:18.881644 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:19.245062 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a8b696d3-5ef1-49b4-be27-adff5d7f7cc6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:19.248907 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:19.252533 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a8b696d3-5ef1-49b4-be27-adff5d7f7cc6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.385513 Jul 28 09:12:19.253095 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 78/164] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:18 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:19.257597 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:19.257992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2a158adb-52d0-425e-8de8-1b3bbb02b794 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:19.258587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2a158adb-52d0-425e-8de8-1b3bbb02b794 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:19.259112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:19.260193 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cf4ec045-4ffa-4bcc-8f88-08ce581b4bf3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.390645 Jul 28 09:12:19.264397 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a158adb-52d0-425e-8de8-1b3bbb02b794 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:19.264842 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a158adb-52d0-425e-8de8-1b3bbb02b794 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:19.265601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a158adb-52d0-425e-8de8-1b3bbb02b794 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:19.266064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a158adb-52d0-425e-8de8-1b3bbb02b794 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:19.266471 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 87/165] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:18 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:19.391500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2a158adb-52d0-425e-8de8-1b3bbb02b794 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:19.399724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2a158adb-52d0-425e-8de8-1b3bbb02b794 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.145109 Jul 28 09:12:19.400289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 79/166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:19 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:19.696036 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-27d0ad4f-0194-44b1-9cbe-316a5992c724 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:19.696644 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-27d0ad4f-0194-44b1-9cbe-316a5992c724 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:19.698362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-653b0ae5-d9ed-4444-a1fa-9f8c824f6ee1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:19.698996 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-653b0ae5-d9ed-4444-a1fa-9f8c824f6ee1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:19.703002 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-27d0ad4f-0194-44b1-9cbe-316a5992c724 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:19.703447 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-27d0ad4f-0194-44b1-9cbe-316a5992c724 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:19.704205 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-27d0ad4f-0194-44b1-9cbe-316a5992c724 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:19.704637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-27d0ad4f-0194-44b1-9cbe-316a5992c724 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:19.704830 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-653b0ae5-d9ed-4444-a1fa-9f8c824f6ee1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:19.705273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-653b0ae5-d9ed-4444-a1fa-9f8c824f6ee1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:19.706060 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-653b0ae5-d9ed-4444-a1fa-9f8c824f6ee1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:19.706475 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-653b0ae5-d9ed-4444-a1fa-9f8c824f6ee1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:19.708518 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:19.901013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-653b0ae5-d9ed-4444-a1fa-9f8c824f6ee1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:19.902688 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-27d0ad4f-0194-44b1-9cbe-316a5992c724 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:19.911151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-27d0ad4f-0194-44b1-9cbe-316a5992c724 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.218895 Jul 28 09:12:19.911726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 88/167] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:19 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:19.912555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-653b0ae5-d9ed-4444-a1fa-9f8c824f6ee1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.218058 Jul 28 09:12:19.913133 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 80/168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:19 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:20.273820 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2b2b8bf5-0e5e-436e-8e55-7f08ca644dcb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:20.274442 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2b2b8bf5-0e5e-436e-8e55-7f08ca644dcb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:20.280740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2b2b8bf5-0e5e-436e-8e55-7f08ca644dcb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.281179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2b2b8bf5-0e5e-436e-8e55-7f08ca644dcb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.281959 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2b2b8bf5-0e5e-436e-8e55-7f08ca644dcb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.282393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2b2b8bf5-0e5e-436e-8e55-7f08ca644dcb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.282545 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:20.283153 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:20.289116 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.289564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.290345 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.290777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.471280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2b2b8bf5-0e5e-436e-8e55-7f08ca644dcb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:20.478129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:20.478792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2b2b8bf5-0e5e-436e-8e55-7f08ca644dcb tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.208838 Jul 28 09:12:20.479369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 89/169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:20 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:20.492677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-624de79b-5b6c-4185-ad37-8d8d08e88ab9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:20.492677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-624de79b-5b6c-4185-ad37-8d8d08e88ab9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:20.492860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:20.492860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:20.492860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ca018354-bb7c-49a0-9609-44ecb221f899 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.210989 Jul 28 09:12:20.493096 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 81/170] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:20 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:20.493163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-624de79b-5b6c-4185-ad37-8d8d08e88ab9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.493163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-624de79b-5b6c-4185-ad37-8d8d08e88ab9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.493163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-624de79b-5b6c-4185-ad37-8d8d08e88ab9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.493163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-624de79b-5b6c-4185-ad37-8d8d08e88ab9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.624611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-624de79b-5b6c-4185-ad37-8d8d08e88ab9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:20.633645 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-624de79b-5b6c-4185-ad37-8d8d08e88ab9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.153322 Jul 28 09:12:20.634250 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 90/171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:20 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:20.932415 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9ffd328b-1960-4fdc-926c-47b3c122f719 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:20.933023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9ffd328b-1960-4fdc-926c-47b3c122f719 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:20.933464 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8ed814ae-24cd-4710-ac79-f390ac55cc17 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:20.934100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8ed814ae-24cd-4710-ac79-f390ac55cc17 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:20.939191 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9ffd328b-1960-4fdc-926c-47b3c122f719 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.939643 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9ffd328b-1960-4fdc-926c-47b3c122f719 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.939956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8ed814ae-24cd-4710-ac79-f390ac55cc17 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.940400 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8ed814ae-24cd-4710-ac79-f390ac55cc17 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.940531 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9ffd328b-1960-4fdc-926c-47b3c122f719 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.940841 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9ffd328b-1960-4fdc-926c-47b3c122f719 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:20.941559 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8ed814ae-24cd-4710-ac79-f390ac55cc17 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:20.941916 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8ed814ae-24cd-4710-ac79-f390ac55cc17 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:21.129356 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9ffd328b-1960-4fdc-926c-47b3c122f719 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:21.136127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8ed814ae-24cd-4710-ac79-f390ac55cc17 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:21.136678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9ffd328b-1960-4fdc-926c-47b3c122f719 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.208127 Jul 28 09:12:21.137255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 82/172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:20 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:21.143571 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8ed814ae-24cd-4710-ac79-f390ac55cc17 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.213877 Jul 28 09:12:21.144630 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 91/173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:20 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:21.500936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e78a6484-7c71-456b-9694-e5863c82144f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:21.501469 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e78a6484-7c71-456b-9694-e5863c82144f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:21.507993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e78a6484-7c71-456b-9694-e5863c82144f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:21.508437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e78a6484-7c71-456b-9694-e5863c82144f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:21.509194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e78a6484-7c71-456b-9694-e5863c82144f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:21.509621 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e78a6484-7c71-456b-9694-e5863c82144f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:21.512392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:21.512999 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:21.519700 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:21.520143 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:21.520935 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:21.521360 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:21.712246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e78a6484-7c71-456b-9694-e5863c82144f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:21.718905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:21.719864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e78a6484-7c71-456b-9694-e5863c82144f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.222819 Jul 28 09:12:21.720430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 83/174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:21 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:21.725176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9db165bc-f318-4886-a379-a4c4bc9ba033 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:21.725813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9db165bc-f318-4886-a379-a4c4bc9ba033 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:21.727584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:21.729154 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:21.730373 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-748b618d-5eed-4690-9617-637367430774 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.221932 Jul 28 09:12:21.731038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 92/175] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:21 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:21.731502 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9db165bc-f318-4886-a379-a4c4bc9ba033 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:21.732120 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9db165bc-f318-4886-a379-a4c4bc9ba033 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:21.732965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9db165bc-f318-4886-a379-a4c4bc9ba033 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:21.733401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9db165bc-f318-4886-a379-a4c4bc9ba033 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:21.861647 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9db165bc-f318-4886-a379-a4c4bc9ba033 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:21.869462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9db165bc-f318-4886-a379-a4c4bc9ba033 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.148096 Jul 28 09:12:21.870061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 84/176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:21 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:22.158516 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-22f9c7a3-73ea-4ed5-8f5f-c02358d6b3d7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:22.159292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-22f9c7a3-73ea-4ed5-8f5f-c02358d6b3d7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:22.165408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c07a0ca2-6c6a-4f15-99ef-f04aa53eb471 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:22.166108 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c07a0ca2-6c6a-4f15-99ef-f04aa53eb471 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:22.166359 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22f9c7a3-73ea-4ed5-8f5f-c02358d6b3d7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.166913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22f9c7a3-73ea-4ed5-8f5f-c02358d6b3d7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.167863 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22f9c7a3-73ea-4ed5-8f5f-c02358d6b3d7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.168126 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22f9c7a3-73ea-4ed5-8f5f-c02358d6b3d7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.173790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c07a0ca2-6c6a-4f15-99ef-f04aa53eb471 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.174455 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c07a0ca2-6c6a-4f15-99ef-f04aa53eb471 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.175919 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c07a0ca2-6c6a-4f15-99ef-f04aa53eb471 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.176353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c07a0ca2-6c6a-4f15-99ef-f04aa53eb471 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.365061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-22f9c7a3-73ea-4ed5-8f5f-c02358d6b3d7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:22.372548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-22f9c7a3-73ea-4ed5-8f5f-c02358d6b3d7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.217952 Jul 28 09:12:22.373118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 93/177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:22 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:22.376518 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c07a0ca2-6c6a-4f15-99ef-f04aa53eb471 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:22.378528 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-2733472f-226d-49dc-ab7a-39a154cca43a req-ff583e99-819a-41d5-b014-13874ed012f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8684b5-28bd-4cba-a505-ac85060610e3", "name": "network-vif-plugged", "status": "completed", "tag": "05fba3af-c7cc-4269-9374-da786cec1fa9"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:22.387745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-2733472f-226d-49dc-ab7a-39a154cca43a req-ff583e99-819a-41d5-b014-13874ed012f1 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.388182 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c07a0ca2-6c6a-4f15-99ef-f04aa53eb471 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.226979 Jul 28 09:12:22.388323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-2733472f-226d-49dc-ab7a-39a154cca43a req-ff583e99-819a-41d5-b014-13874ed012f1 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.389282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 85/178] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:22 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:22.399777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-2733472f-226d-49dc-ab7a-39a154cca43a req-ff583e99-819a-41d5-b014-13874ed012f1 service nova] Creating event network-vif-plugged:05fba3af-c7cc-4269-9374-da786cec1fa9 for instance fb8684b5-28bd-4cba-a505-ac85060610e3 on hv-cinder-85124 Jul 28 09:12:22.404912 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-2733472f-226d-49dc-ab7a-39a154cca43a req-ff583e99-819a-41d5-b014-13874ed012f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Jul 28 09:12:22.405497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 94/179] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:22.740311 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-21bc02dd-aa2c-4a1d-a4a6-b1a46b8fd854 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:22.740908 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-21bc02dd-aa2c-4a1d-a4a6-b1a46b8fd854 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:22.754776 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:22.754988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-21bc02dd-aa2c-4a1d-a4a6-b1a46b8fd854 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.755532 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-21bc02dd-aa2c-4a1d-a4a6-b1a46b8fd854 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.755865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:22.756763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-21bc02dd-aa2c-4a1d-a4a6-b1a46b8fd854 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.757281 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-21bc02dd-aa2c-4a1d-a4a6-b1a46b8fd854 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.779101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.779550 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.780328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:22.780757 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:22.963556 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-21bc02dd-aa2c-4a1d-a4a6-b1a46b8fd854 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:22.977201 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-21bc02dd-aa2c-4a1d-a4a6-b1a46b8fd854 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.240583 Jul 28 09:12:22.977788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 86/180] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:22 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:22.990080 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7ee5b443-b9a0-4026-a8ce-68abd9161116 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:22.990080 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7ee5b443-b9a0-4026-a8ce-68abd9161116 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:23.001423 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ee5b443-b9a0-4026-a8ce-68abd9161116 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:23.008358 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ee5b443-b9a0-4026-a8ce-68abd9161116 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:23.009508 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ee5b443-b9a0-4026-a8ce-68abd9161116 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:23.010131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ee5b443-b9a0-4026-a8ce-68abd9161116 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:23.080780 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:23.090175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:23.091973 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:23.093517 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-54d70b88-a846-4dd7-9a65-83f621ac3e7c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.342695 Jul 28 09:12:23.094347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 95/181] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:22 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:23.198993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7ee5b443-b9a0-4026-a8ce-68abd9161116 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:23.208162 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7ee5b443-b9a0-4026-a8ce-68abd9161116 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.229290 Jul 28 09:12:23.208780 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 87/182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:22 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:23.395274 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-db636060-61a2-4984-bf93-1596323fe0ea tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:23.395881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-db636060-61a2-4984-bf93-1596323fe0ea tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:23.411121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e1d06d8a-ef5a-472b-a00d-29e8f14fb781 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:23.412017 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e1d06d8a-ef5a-472b-a00d-29e8f14fb781 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:23.416484 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-db636060-61a2-4984-bf93-1596323fe0ea tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:23.419182 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-db636060-61a2-4984-bf93-1596323fe0ea tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:23.421768 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-db636060-61a2-4984-bf93-1596323fe0ea tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:23.422414 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-db636060-61a2-4984-bf93-1596323fe0ea tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:23.427662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e1d06d8a-ef5a-472b-a00d-29e8f14fb781 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:23.428127 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e1d06d8a-ef5a-472b-a00d-29e8f14fb781 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:23.430376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e1d06d8a-ef5a-472b-a00d-29e8f14fb781 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:23.430828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e1d06d8a-ef5a-472b-a00d-29e8f14fb781 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:23.918547 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-db636060-61a2-4984-bf93-1596323fe0ea tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:23.927858 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-db636060-61a2-4984-bf93-1596323fe0ea tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.537138 Jul 28 09:12:23.928684 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 96/183] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:23 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:23.943591 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e1d06d8a-ef5a-472b-a00d-29e8f14fb781 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:23.951289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e1d06d8a-ef5a-472b-a00d-29e8f14fb781 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.545397 Jul 28 09:12:23.951854 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 88/184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:23 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:24.002357 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a605a65e-60af-4862-b47f-c2e31222d349 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:24.002971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a605a65e-60af-4862-b47f-c2e31222d349 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:24.009549 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a605a65e-60af-4862-b47f-c2e31222d349 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.010056 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a605a65e-60af-4862-b47f-c2e31222d349 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.010830 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a605a65e-60af-4862-b47f-c2e31222d349 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.011441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a605a65e-60af-4862-b47f-c2e31222d349 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.121783 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:24.122577 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:24.136929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.137488 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.147287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.147825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.591506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a605a65e-60af-4862-b47f-c2e31222d349 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:24.601430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:24.602030 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a605a65e-60af-4862-b47f-c2e31222d349 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.603187 Jul 28 09:12:24.602526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 97/185] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:23 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:24.609801 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:24.611328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:24.612423 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-55f83746-8191-40ee-89cd-3131a20c264f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.495824 Jul 28 09:12:24.617923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-55c70c0f-f863-4e94-9c68-1493b1af5e85 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:24.617923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-55c70c0f-f863-4e94-9c68-1493b1af5e85 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:24.618393 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 89/186] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:24 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:24.621793 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55c70c0f-f863-4e94-9c68-1493b1af5e85 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.622283 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55c70c0f-f863-4e94-9c68-1493b1af5e85 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.623112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55c70c0f-f863-4e94-9c68-1493b1af5e85 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.623554 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55c70c0f-f863-4e94-9c68-1493b1af5e85 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.760674 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-55c70c0f-f863-4e94-9c68-1493b1af5e85 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:24.768654 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-55c70c0f-f863-4e94-9c68-1493b1af5e85 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.158918 Jul 28 09:12:24.769404 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 98/187] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:24 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:24.949173 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d1369415-9129-4c79-a3ac-56dd267e6858 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:24.950142 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d1369415-9129-4c79-a3ac-56dd267e6858 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:24.956833 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d1369415-9129-4c79-a3ac-56dd267e6858 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.957803 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d1369415-9129-4c79-a3ac-56dd267e6858 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.958880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d1369415-9129-4c79-a3ac-56dd267e6858 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.959374 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d1369415-9129-4c79-a3ac-56dd267e6858 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.972616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fc6129a6-5415-4279-8cc7-a5b8f3e6ea63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:24.974636 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fc6129a6-5415-4279-8cc7-a5b8f3e6ea63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:24.984579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc6129a6-5415-4279-8cc7-a5b8f3e6ea63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.984579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc6129a6-5415-4279-8cc7-a5b8f3e6ea63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:24.991213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc6129a6-5415-4279-8cc7-a5b8f3e6ea63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:24.994646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc6129a6-5415-4279-8cc7-a5b8f3e6ea63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:25.220398 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d1369415-9129-4c79-a3ac-56dd267e6858 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:25.226530 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:25.232983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fc6129a6-5415-4279-8cc7-a5b8f3e6ea63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:25.233438 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d1369415-9129-4c79-a3ac-56dd267e6858 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.288749 Jul 28 09:12:25.234064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 90/188] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:24 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:25.246396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fc6129a6-5415-4279-8cc7-a5b8f3e6ea63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.277466 Jul 28 09:12:25.247222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 99/189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:24 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:25.629535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-23c2b33f-231d-45dc-895f-e29773fe6b6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:25.631832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-23c2b33f-231d-45dc-895f-e29773fe6b6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:25.637480 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-23c2b33f-231d-45dc-895f-e29773fe6b6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:25.638151 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-23c2b33f-231d-45dc-895f-e29773fe6b6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:25.638948 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-23c2b33f-231d-45dc-895f-e29773fe6b6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:25.639381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:25.639829 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-23c2b33f-231d-45dc-895f-e29773fe6b6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:25.640786 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:25.654677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:25.655375 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:25.657440 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:25.658264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:26.126109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-23c2b33f-231d-45dc-895f-e29773fe6b6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:26.129046 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:26.136914 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-23c2b33f-231d-45dc-895f-e29773fe6b6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.516633 Jul 28 09:12:26.138056 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 91/190] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:25 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:26.138857 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:26.140565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:26.141722 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7d1f7f6b-50f2-41e5-aef5-421bf436c656 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.508682 Jul 28 09:12:26.142311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 100/191] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:25 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:26.146131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-498cb8e2-bf5e-4168-8a35-ef0e2ddc3efa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:26.146131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-498cb8e2-bf5e-4168-8a35-ef0e2ddc3efa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:26.149858 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-498cb8e2-bf5e-4168-8a35-ef0e2ddc3efa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:26.150532 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-498cb8e2-bf5e-4168-8a35-ef0e2ddc3efa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:26.151525 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-498cb8e2-bf5e-4168-8a35-ef0e2ddc3efa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:26.152191 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-498cb8e2-bf5e-4168-8a35-ef0e2ddc3efa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:26.256022 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3c9771b1-319c-4596-91d2-5174c1acc481 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:26.256901 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3c9771b1-319c-4596-91d2-5174c1acc481 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:26.264460 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3c9771b1-319c-4596-91d2-5174c1acc481 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:26.266573 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3c9771b1-319c-4596-91d2-5174c1acc481 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:26.267777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3c9771b1-319c-4596-91d2-5174c1acc481 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:26.268384 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3c9771b1-319c-4596-91d2-5174c1acc481 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:26.313065 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-498cb8e2-bf5e-4168-8a35-ef0e2ddc3efa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:26.324556 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-498cb8e2-bf5e-4168-8a35-ef0e2ddc3efa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.185213 Jul 28 09:12:26.325143 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 92/192] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:26 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:26.330121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c8aca47f-d4f9-43a6-862f-f5ea8b56f859 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:26.330924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c8aca47f-d4f9-43a6-862f-f5ea8b56f859 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:26.338872 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c8aca47f-d4f9-43a6-862f-f5ea8b56f859 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:26.339548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c8aca47f-d4f9-43a6-862f-f5ea8b56f859 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:26.340512 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c8aca47f-d4f9-43a6-862f-f5ea8b56f859 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:26.341869 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c8aca47f-d4f9-43a6-862f-f5ea8b56f859 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:26.491873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3c9771b1-319c-4596-91d2-5174c1acc481 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:26.500254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3c9771b1-319c-4596-91d2-5174c1acc481 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.248690 Jul 28 09:12:26.501277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 101/193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:26 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:26.506531 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-54678ba6-58ee-491c-82d0-2d7c68f64b84 req-99e64c55-782d-4f61-bab5-812170e354b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6936b19d-2a6d-4b60-a88f-549320d81537", "name": "network-vif-plugged", "status": "completed", "tag": "e8f10ca5-9e77-4e44-90da-226feaaaae51"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:26.516788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c8aca47f-d4f9-43a6-862f-f5ea8b56f859 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:26.518732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-54678ba6-58ee-491c-82d0-2d7c68f64b84 req-99e64c55-782d-4f61-bab5-812170e354b9 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:26.519180 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-54678ba6-58ee-491c-82d0-2d7c68f64b84 req-99e64c55-782d-4f61-bab5-812170e354b9 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:26.526213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c8aca47f-d4f9-43a6-862f-f5ea8b56f859 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.199873 Jul 28 09:12:26.527624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 93/194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:26 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:26.530907 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-54678ba6-58ee-491c-82d0-2d7c68f64b84 req-99e64c55-782d-4f61-bab5-812170e354b9 service nova] Creating event network-vif-plugged:e8f10ca5-9e77-4e44-90da-226feaaaae51 for instance 6936b19d-2a6d-4b60-a88f-549320d81537 on hv-cinder-85124 Jul 28 09:12:26.536100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-54678ba6-58ee-491c-82d0-2d7c68f64b84 req-99e64c55-782d-4f61-bab5-812170e354b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Jul 28 09:12:26.536682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 102/195] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:27.166906 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:27.167602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:27.169753 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5d32b8a0-bc8e-450f-ac3a-2ef48d0e2aed tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:27.170392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5d32b8a0-bc8e-450f-ac3a-2ef48d0e2aed tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:27.174167 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.174620 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.175462 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.176236 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.176817 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5d32b8a0-bc8e-450f-ac3a-2ef48d0e2aed tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.177259 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5d32b8a0-bc8e-450f-ac3a-2ef48d0e2aed tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.178041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5d32b8a0-bc8e-450f-ac3a-2ef48d0e2aed tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.178473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5d32b8a0-bc8e-450f-ac3a-2ef48d0e2aed tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.383853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:27.387157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5d32b8a0-bc8e-450f-ac3a-2ef48d0e2aed tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:27.392486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:27.394137 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:27.394927 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5d32b8a0-bc8e-450f-ac3a-2ef48d0e2aed tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.234861 Jul 28 09:12:27.395504 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 94/196] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:27 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:27.395783 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-caef2645-2736-4696-8cf7-029fcb7add8d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.233020 Jul 28 09:12:27.396683 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 103/197] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:27 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:27.399893 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-37462e81-e4cf-4bca-8744-f435748fdf40 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:27.400486 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-37462e81-e4cf-4bca-8744-f435748fdf40 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:27.406394 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37462e81-e4cf-4bca-8744-f435748fdf40 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.407001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37462e81-e4cf-4bca-8744-f435748fdf40 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.407758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37462e81-e4cf-4bca-8744-f435748fdf40 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.408189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37462e81-e4cf-4bca-8744-f435748fdf40 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.528132 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8824d4a9-3707-4d00-960e-31d16694cbd6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:27.528749 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8824d4a9-3707-4d00-960e-31d16694cbd6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:27.538096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8824d4a9-3707-4d00-960e-31d16694cbd6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.538747 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8824d4a9-3707-4d00-960e-31d16694cbd6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.539524 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8824d4a9-3707-4d00-960e-31d16694cbd6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.539963 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8824d4a9-3707-4d00-960e-31d16694cbd6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.592188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-37462e81-e4cf-4bca-8744-f435748fdf40 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:27.601367 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-37462e81-e4cf-4bca-8744-f435748fdf40 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.204899 Jul 28 09:12:27.614625 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 95/198] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:27 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:27.619331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8d7efb44-80b4-48d2-ab3f-dfea6c9aa5b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:27.619937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8d7efb44-80b4-48d2-ab3f-dfea6c9aa5b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:27.626771 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d7efb44-80b4-48d2-ab3f-dfea6c9aa5b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.627216 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d7efb44-80b4-48d2-ab3f-dfea6c9aa5b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.628105 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d7efb44-80b4-48d2-ab3f-dfea6c9aa5b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:27.628686 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d7efb44-80b4-48d2-ab3f-dfea6c9aa5b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:27.690324 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8824d4a9-3707-4d00-960e-31d16694cbd6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:27.698183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8824d4a9-3707-4d00-960e-31d16694cbd6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1315 microversion: 2.1 time: 0.180922 Jul 28 09:12:27.698760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 104/199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:27 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:27.786195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8d7efb44-80b4-48d2-ab3f-dfea6c9aa5b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:27.793513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8d7efb44-80b4-48d2-ab3f-dfea6c9aa5b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.177874 Jul 28 09:12:27.794136 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 96/200] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:27 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:28.417366 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-af4487bf-b517-4776-895e-6d4173d11660 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:28.418290 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-af4487bf-b517-4776-895e-6d4173d11660 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:28.419867 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:28.420962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:28.424506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af4487bf-b517-4776-895e-6d4173d11660 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.424955 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af4487bf-b517-4776-895e-6d4173d11660 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.426333 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af4487bf-b517-4776-895e-6d4173d11660 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.427130 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af4487bf-b517-4776-895e-6d4173d11660 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.428567 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.429257 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.430153 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.430813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.640127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-af4487bf-b517-4776-895e-6d4173d11660 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:28.647492 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-af4487bf-b517-4776-895e-6d4173d11660 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.234902 Jul 28 09:12:28.649221 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:28.657350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:28.658590 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 105/201] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:28 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:28.659116 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:28.660974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4a59a7fd-8d80-4cf6-b59f-ac8cfdfc18a5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.245686 Jul 28 09:12:28.661713 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 97/202] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:28 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:28.664976 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2e39c0ad-a9c5-414a-8880-0593ed1ffc71 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:28.665586 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2e39c0ad-a9c5-414a-8880-0593ed1ffc71 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:28.673516 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2e39c0ad-a9c5-414a-8880-0593ed1ffc71 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.674001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2e39c0ad-a9c5-414a-8880-0593ed1ffc71 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.674759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2e39c0ad-a9c5-414a-8880-0593ed1ffc71 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.675221 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2e39c0ad-a9c5-414a-8880-0593ed1ffc71 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.680195 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:28.722448 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-42e7a0e7-c0e7-48fb-af59-2c60d6bc0ec4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:28.723585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-42e7a0e7-c0e7-48fb-af59-2c60d6bc0ec4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:28.730269 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-42e7a0e7-c0e7-48fb-af59-2c60d6bc0ec4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.730715 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-42e7a0e7-c0e7-48fb-af59-2c60d6bc0ec4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.731480 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-42e7a0e7-c0e7-48fb-af59-2c60d6bc0ec4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.731913 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-42e7a0e7-c0e7-48fb-af59-2c60d6bc0ec4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.901556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2e39c0ad-a9c5-414a-8880-0593ed1ffc71 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:28.910054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2e39c0ad-a9c5-414a-8880-0593ed1ffc71 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.249952 Jul 28 09:12:28.910864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 106/203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:28 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:28.916335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-239f3046-85be-4be2-9838-852c566d841e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:28.917111 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-239f3046-85be-4be2-9838-852c566d841e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:28.923259 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-239f3046-85be-4be2-9838-852c566d841e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.925044 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-239f3046-85be-4be2-9838-852c566d841e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.926531 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-239f3046-85be-4be2-9838-852c566d841e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:28.927116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-239f3046-85be-4be2-9838-852c566d841e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:28.955482 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-42e7a0e7-c0e7-48fb-af59-2c60d6bc0ec4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:28.963254 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-42e7a0e7-c0e7-48fb-af59-2c60d6bc0ec4 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1502 microversion: 2.1 time: 0.244573 Jul 28 09:12:28.963827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 98/204] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:28 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:29.075115 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-239f3046-85be-4be2-9838-852c566d841e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:29.085714 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-239f3046-85be-4be2-9838-852c566d841e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.173636 Jul 28 09:12:29.086528 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 107/205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:28 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:29.668571 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-eab16286-c69b-4856-84b4-c1a467b763ab tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:29.669328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-eab16286-c69b-4856-84b4-c1a467b763ab tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:29.675450 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eab16286-c69b-4856-84b4-c1a467b763ab tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:29.676446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eab16286-c69b-4856-84b4-c1a467b763ab tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:29.677215 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eab16286-c69b-4856-84b4-c1a467b763ab tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:29.677659 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eab16286-c69b-4856-84b4-c1a467b763ab tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:29.685871 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:29.687010 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:29.695055 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:29.695785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:29.697183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:29.698214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:29.890038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:29.894486 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-eab16286-c69b-4856-84b4-c1a467b763ab tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:29.899868 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:29.902039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-eab16286-c69b-4856-84b4-c1a467b763ab tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.237221 Jul 28 09:12:29.902373 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:29.902606 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 99/206] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:29 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:29.903884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8d700c6c-c20e-4422-863d-ae3fa1cba73f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.223254 Jul 28 09:12:29.904424 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 108/207] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:29 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:29.932435 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d1e588c2-0399-4f7f-8e54-ad3f1fd68b6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:29.933045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d1e588c2-0399-4f7f-8e54-ad3f1fd68b6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:29.938937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d1e588c2-0399-4f7f-8e54-ad3f1fd68b6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:29.939572 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d1e588c2-0399-4f7f-8e54-ad3f1fd68b6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:29.940332 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d1e588c2-0399-4f7f-8e54-ad3f1fd68b6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:29.940768 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d1e588c2-0399-4f7f-8e54-ad3f1fd68b6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:30.070855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d1e588c2-0399-4f7f-8e54-ad3f1fd68b6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:30.078720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d1e588c2-0399-4f7f-8e54-ad3f1fd68b6e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.150085 Jul 28 09:12:30.079362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 100/208] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:29 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:30.106366 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-57980a48-462f-4923-9119-3fbab98be180 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:30.106965 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-57980a48-462f-4923-9119-3fbab98be180 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:30.112958 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-57980a48-462f-4923-9119-3fbab98be180 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:30.113955 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-57980a48-462f-4923-9119-3fbab98be180 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:30.114721 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-57980a48-462f-4923-9119-3fbab98be180 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:30.115145 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-57980a48-462f-4923-9119-3fbab98be180 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:30.252711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-57980a48-462f-4923-9119-3fbab98be180 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:30.260565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-57980a48-462f-4923-9119-3fbab98be180 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.158050 Jul 28 09:12:30.261136 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 109/209] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:30 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:30.929540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:30.930099 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-21fe880d-6503-4504-9956-38288721701e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:30.930992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-21fe880d-6503-4504-9956-38288721701e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:30.931756 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:30.938974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-21fe880d-6503-4504-9956-38288721701e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:30.939357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-21fe880d-6503-4504-9956-38288721701e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:30.939791 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:30.940122 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-21fe880d-6503-4504-9956-38288721701e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:30.940222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:30.940566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-21fe880d-6503-4504-9956-38288721701e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:30.941019 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:30.941449 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:31.152641 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:31.155752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-21fe880d-6503-4504-9956-38288721701e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:31.163705 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-21fe880d-6503-4504-9956-38288721701e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.244163 Jul 28 09:12:31.163970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:31.164256 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 101/210] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:30 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:31.165767 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:31.166928 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4b6f6793-1306-4b05-ae88-e145692a3818 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.243752 Jul 28 09:12:31.167478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 110/211] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:30 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:31.168821 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-47e0c6ec-55fd-4dad-bc25-e461e663a818 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:31.169468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-47e0c6ec-55fd-4dad-bc25-e461e663a818 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:31.175337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-47e0c6ec-55fd-4dad-bc25-e461e663a818 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:31.175791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-47e0c6ec-55fd-4dad-bc25-e461e663a818 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:31.177147 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-47e0c6ec-55fd-4dad-bc25-e461e663a818 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:31.177593 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-47e0c6ec-55fd-4dad-bc25-e461e663a818 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:31.281745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3f8156a6-3387-4017-8947-bc79b20153eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:31.282556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3f8156a6-3387-4017-8947-bc79b20153eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:31.289249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f8156a6-3387-4017-8947-bc79b20153eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:31.289926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f8156a6-3387-4017-8947-bc79b20153eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:31.290896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f8156a6-3387-4017-8947-bc79b20153eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:31.291483 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f8156a6-3387-4017-8947-bc79b20153eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:31.327614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-47e0c6ec-55fd-4dad-bc25-e461e663a818 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:31.336545 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-47e0c6ec-55fd-4dad-bc25-e461e663a818 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.171156 Jul 28 09:12:31.337125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 102/212] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:31 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:31.463785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3f8156a6-3387-4017-8947-bc79b20153eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:31.487644 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3f8156a6-3387-4017-8947-bc79b20153eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1322 microversion: 2.1 time: 0.209495 Jul 28 09:12:31.488154 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 111/213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:31 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:32.185570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dea0c5e3-5d13-473f-bd93-d676d2bb98c8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:32.186893 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dea0c5e3-5d13-473f-bd93-d676d2bb98c8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:32.190393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:32.190994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:32.195890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dea0c5e3-5d13-473f-bd93-d676d2bb98c8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.196578 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dea0c5e3-5d13-473f-bd93-d676d2bb98c8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.197991 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dea0c5e3-5d13-473f-bd93-d676d2bb98c8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.198425 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.198906 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.199031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dea0c5e3-5d13-473f-bd93-d676d2bb98c8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.200126 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.200655 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.459860 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:32.467985 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:32.485567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:32.487132 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cd2b8bfe-78dd-41da-8953-6e28b7c31718 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.300597 Jul 28 09:12:32.487874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 112/214] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:32 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:32.494037 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5d9de01f-45f1-4519-9861-6c7bc5f22917 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:32.494851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5d9de01f-45f1-4519-9861-6c7bc5f22917 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:32.501197 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5d9de01f-45f1-4519-9861-6c7bc5f22917 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.501983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5d9de01f-45f1-4519-9861-6c7bc5f22917 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.503540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5d9de01f-45f1-4519-9861-6c7bc5f22917 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.504823 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5d9de01f-45f1-4519-9861-6c7bc5f22917 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.519126 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dea0c5e3-5d13-473f-bd93-d676d2bb98c8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:32.528260 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dea0c5e3-5d13-473f-bd93-d676d2bb98c8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.346936 Jul 28 09:12:32.529124 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 103/215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:32 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:32.537378 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7c07f884-1bbc-4cdb-820c-9a634849c1c0 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92c6b85b-e715-4c63-84bd-436f2890c7bb"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:32.540626 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7c07f884-1bbc-4cdb-820c-9a634849c1c0 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:32.547901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c07f884-1bbc-4cdb-820c-9a634849c1c0 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.548616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c07f884-1bbc-4cdb-820c-9a634849c1c0 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.549891 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c07f884-1bbc-4cdb-820c-9a634849c1c0 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.550789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c07f884-1bbc-4cdb-820c-9a634849c1c0 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.749949 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5d9de01f-45f1-4519-9861-6c7bc5f22917 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:32.784125 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5d9de01f-45f1-4519-9861-6c7bc5f22917 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.294958 Jul 28 09:12:32.789438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 113/216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:32 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:32.796323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3e807970-af4e-410b-bd08-34394e19c349 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:32.796952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3e807970-af4e-410b-bd08-34394e19c349 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:32.814851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e807970-af4e-410b-bd08-34394e19c349 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.815306 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e807970-af4e-410b-bd08-34394e19c349 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:32.816094 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e807970-af4e-410b-bd08-34394e19c349 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:32.816536 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e807970-af4e-410b-bd08-34394e19c349 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:33.012183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3e807970-af4e-410b-bd08-34394e19c349 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:33.019582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3e807970-af4e-410b-bd08-34394e19c349 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1515 microversion: 2.1 time: 0.228250 Jul 28 09:12:33.020265 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 114/217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:32 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:33.041814 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-35f1757a-8f89-465c-8021-4f90702437b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:33.044198 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-35f1757a-8f89-465c-8021-4f90702437b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:33.050260 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35f1757a-8f89-465c-8021-4f90702437b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:33.050723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35f1757a-8f89-465c-8021-4f90702437b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:33.052134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35f1757a-8f89-465c-8021-4f90702437b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:33.052839 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35f1757a-8f89-465c-8021-4f90702437b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:33.149754 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-35f1757a-8f89-465c-8021-4f90702437b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lazy-loading 'flavor' on Instance uuid fb8684b5-28bd-4cba-a505-ac85060610e3 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:12:33.274327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-35f1757a-8f89-465c-8021-4f90702437b9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3/action" status: 200 len: 32 microversion: 2.1 time: 0.236222 Jul 28 09:12:33.275633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 115/218] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:12:33 2022] POST /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3/action => generated 32 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:12:33.289869 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0dfe0dfe-e5cd-4fc3-9688-2dd524666737 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:33.291311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0dfe0dfe-e5cd-4fc3-9688-2dd524666737 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:33.299894 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0dfe0dfe-e5cd-4fc3-9688-2dd524666737 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:33.300907 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0dfe0dfe-e5cd-4fc3-9688-2dd524666737 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:33.302396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0dfe0dfe-e5cd-4fc3-9688-2dd524666737 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:33.302986 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0dfe0dfe-e5cd-4fc3-9688-2dd524666737 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:33.601506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7c07f884-1bbc-4cdb-820c-9a634849c1c0 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "POST /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.070480 Jul 28 09:12:33.602348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 104/219] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:12:32 2022] POST /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a/os-volume_attachments => generated 194 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:33.612848 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:33.613773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:33.622205 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:33.623038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:33.624004 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:33.624535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:33.707106 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0dfe0dfe-e5cd-4fc3-9688-2dd524666737 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:33.718223 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0dfe0dfe-e5cd-4fc3-9688-2dd524666737 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.437497 Jul 28 09:12:33.719071 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 116/220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:33 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:33.724000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b7e5c7ce-688b-4bc9-bc55-f96c5649032f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:33.724599 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b7e5c7ce-688b-4bc9-bc55-f96c5649032f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:33.745388 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7e5c7ce-688b-4bc9-bc55-f96c5649032f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:33.745852 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7e5c7ce-688b-4bc9-bc55-f96c5649032f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:33.746639 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7e5c7ce-688b-4bc9-bc55-f96c5649032f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:33.747074 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7e5c7ce-688b-4bc9-bc55-f96c5649032f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:34.001365 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:34.015209 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:34.021782 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:34.024062 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-fc3cb0f1-431d-4e3c-b110-73a67a6cff69 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.420126 Jul 28 09:12:34.025891 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 105/221] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:33 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:34.038557 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-455f2901-cf47-40ff-be12-4997e4ce0ee5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:34.039726 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-455f2901-cf47-40ff-be12-4997e4ce0ee5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:34.054916 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-455f2901-cf47-40ff-be12-4997e4ce0ee5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:34.057375 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b7e5c7ce-688b-4bc9-bc55-f96c5649032f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:34.058239 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-455f2901-cf47-40ff-be12-4997e4ce0ee5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:34.059790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-455f2901-cf47-40ff-be12-4997e4ce0ee5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:34.062438 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-455f2901-cf47-40ff-be12-4997e4ce0ee5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:34.065511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:34.068475 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b7e5c7ce-688b-4bc9-bc55-f96c5649032f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.347593 Jul 28 09:12:34.069989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 117/222] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:33 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:34.245442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-455f2901-cf47-40ff-be12-4997e4ce0ee5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:34.252842 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-455f2901-cf47-40ff-be12-4997e4ce0ee5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.225152 Jul 28 09:12:34.266246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 106/223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:34 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:34.741202 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6845f4f5-4d81-4484-8a8a-93bba18e6fdf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:34.742029 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6845f4f5-4d81-4484-8a8a-93bba18e6fdf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:34.748186 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6845f4f5-4d81-4484-8a8a-93bba18e6fdf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:34.748628 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6845f4f5-4d81-4484-8a8a-93bba18e6fdf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:34.749388 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6845f4f5-4d81-4484-8a8a-93bba18e6fdf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:34.749819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6845f4f5-4d81-4484-8a8a-93bba18e6fdf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:34.893282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6845f4f5-4d81-4484-8a8a-93bba18e6fdf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:34.902507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6845f4f5-4d81-4484-8a8a-93bba18e6fdf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.165474 Jul 28 09:12:34.903270 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 118/224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:34 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:35.048308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:35.048911 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:35.055658 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:35.056122 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:35.057071 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:35.057521 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:35.103517 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8b13b3ce-a2c8-4790-9960-d6e82fd5e0db tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:35.104378 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8b13b3ce-a2c8-4790-9960-d6e82fd5e0db tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:35.110675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8b13b3ce-a2c8-4790-9960-d6e82fd5e0db tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:35.111119 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8b13b3ce-a2c8-4790-9960-d6e82fd5e0db tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:35.111890 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8b13b3ce-a2c8-4790-9960-d6e82fd5e0db tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:35.112317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8b13b3ce-a2c8-4790-9960-d6e82fd5e0db tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:35.290706 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:35.315076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:35.321344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:35.323365 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-587f6c18-1a34-4107-a924-449b7cd12704 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.278308 Jul 28 09:12:35.323960 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 107/225] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:35 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:35.326015 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8b13b3ce-a2c8-4790-9960-d6e82fd5e0db tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:35.328982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d4549bb6-153b-4c97-92c1-b1be14f82967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:35.329691 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d4549bb6-153b-4c97-92c1-b1be14f82967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:35.341968 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d4549bb6-153b-4c97-92c1-b1be14f82967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:35.344257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8b13b3ce-a2c8-4790-9960-d6e82fd5e0db tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.254792 Jul 28 09:12:35.344441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d4549bb6-153b-4c97-92c1-b1be14f82967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:35.345093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 119/226] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:35 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:35.345234 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d4549bb6-153b-4c97-92c1-b1be14f82967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:35.345692 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d4549bb6-153b-4c97-92c1-b1be14f82967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:35.508795 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d4549bb6-153b-4c97-92c1-b1be14f82967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:35.516174 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d4549bb6-153b-4c97-92c1-b1be14f82967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.191007 Jul 28 09:12:35.516730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 108/227] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:35 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:35.923542 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a963c0d9-2567-496e-9aaf-1b336180ac48 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:35.924062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a963c0d9-2567-496e-9aaf-1b336180ac48 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:35.930252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a963c0d9-2567-496e-9aaf-1b336180ac48 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:35.930714 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a963c0d9-2567-496e-9aaf-1b336180ac48 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:35.931468 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a963c0d9-2567-496e-9aaf-1b336180ac48 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:35.931892 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a963c0d9-2567-496e-9aaf-1b336180ac48 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:36.064840 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a963c0d9-2567-496e-9aaf-1b336180ac48 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:36.069151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:36.074969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a963c0d9-2567-496e-9aaf-1b336180ac48 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.155458 Jul 28 09:12:36.075535 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 120/228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:35 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:36.348162 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:36.348826 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:36.355577 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:36.356016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:36.356760 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:36.357188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:36.367415 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c8fa7606-3e50-41e8-95ce-96fb5e6d952f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:36.368113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c8fa7606-3e50-41e8-95ce-96fb5e6d952f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:36.374813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c8fa7606-3e50-41e8-95ce-96fb5e6d952f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:36.375261 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c8fa7606-3e50-41e8-95ce-96fb5e6d952f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:36.376023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c8fa7606-3e50-41e8-95ce-96fb5e6d952f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:36.376454 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c8fa7606-3e50-41e8-95ce-96fb5e6d952f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:36.566194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:36.578562 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c8fa7606-3e50-41e8-95ce-96fb5e6d952f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:36.579633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:36.581161 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:36.582304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-28d47367-1af8-4d1b-bdb2-b2f54ec9c03e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.237967 Jul 28 09:12:36.583232 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 109/229] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:36 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:36.588714 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ff9bdcff-c01a-4d84-b4b9-67bdda989ef1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:36.589457 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ff9bdcff-c01a-4d84-b4b9-67bdda989ef1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:36.596618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ff9bdcff-c01a-4d84-b4b9-67bdda989ef1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:36.597252 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ff9bdcff-c01a-4d84-b4b9-67bdda989ef1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:36.598080 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ff9bdcff-c01a-4d84-b4b9-67bdda989ef1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:36.598574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ff9bdcff-c01a-4d84-b4b9-67bdda989ef1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:36.603908 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c8fa7606-3e50-41e8-95ce-96fb5e6d952f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.241397 Jul 28 09:12:36.619179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 121/230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:36 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:36.744963 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ff9bdcff-c01a-4d84-b4b9-67bdda989ef1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:36.754885 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ff9bdcff-c01a-4d84-b4b9-67bdda989ef1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.170063 Jul 28 09:12:36.758284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 110/231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:36 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:37.097522 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d968ee77-406a-436a-aff5-25595a87f030 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:37.098158 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d968ee77-406a-436a-aff5-25595a87f030 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:37.104633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d968ee77-406a-436a-aff5-25595a87f030 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:37.105080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d968ee77-406a-436a-aff5-25595a87f030 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:37.105854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d968ee77-406a-436a-aff5-25595a87f030 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:37.106292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d968ee77-406a-436a-aff5-25595a87f030 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:37.252802 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d968ee77-406a-436a-aff5-25595a87f030 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:37.260603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d968ee77-406a-436a-aff5-25595a87f030 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.166823 Jul 28 09:12:37.261164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 122/232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:37 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:37.608324 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:37.608936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:37.615946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:37.616386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:37.617134 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:37.617563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:37.627205 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-20992406-b007-410f-b71b-4c4672139134 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:37.627991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-20992406-b007-410f-b71b-4c4672139134 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:37.634958 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20992406-b007-410f-b71b-4c4672139134 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:37.635458 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20992406-b007-410f-b71b-4c4672139134 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:37.636463 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20992406-b007-410f-b71b-4c4672139134 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:37.637141 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20992406-b007-410f-b71b-4c4672139134 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:38.119154 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:38.123064 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-20992406-b007-410f-b71b-4c4672139134 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:38.131732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-20992406-b007-410f-b71b-4c4672139134 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1363 microversion: 2.1 time: 0.508167 Jul 28 09:12:38.132819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 123/233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:37 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1363 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:38.138219 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:38.141794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-752ce6ec-bcb3-4a86-8e2b-dc58141b4e92 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:38.143791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:38.145002 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cf9ba413-bd75-4485-aa2a-e72ce1e3f916 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.540555 Jul 28 09:12:38.155707 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 111/234] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:37 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:38.155788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-752ce6ec-bcb3-4a86-8e2b-dc58141b4e92 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:38.155788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-752ce6ec-bcb3-4a86-8e2b-dc58141b4e92 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:38.155953 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-752ce6ec-bcb3-4a86-8e2b-dc58141b4e92 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:38.156788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-752ce6ec-bcb3-4a86-8e2b-dc58141b4e92 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:38.157233 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-752ce6ec-bcb3-4a86-8e2b-dc58141b4e92 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:38.289246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6c32dbbb-6750-4c64-880d-84f072ee877a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:38.289878 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6c32dbbb-6750-4c64-880d-84f072ee877a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:38.291696 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:38.298506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6c32dbbb-6750-4c64-880d-84f072ee877a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:38.299127 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6c32dbbb-6750-4c64-880d-84f072ee877a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:38.299889 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6c32dbbb-6750-4c64-880d-84f072ee877a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:38.300576 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6c32dbbb-6750-4c64-880d-84f072ee877a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:38.332243 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-752ce6ec-bcb3-4a86-8e2b-dc58141b4e92 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:38.337589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-752ce6ec-bcb3-4a86-8e2b-dc58141b4e92 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.203226 Jul 28 09:12:38.338212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 124/235] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:38 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:38.522590 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6c32dbbb-6750-4c64-880d-84f072ee877a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:38.530815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6c32dbbb-6750-4c64-880d-84f072ee877a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.246762 Jul 28 09:12:38.531460 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 112/236] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:38 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:39.152753 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-adf7a31a-43aa-41a7-b631-ef6c08ecda49 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:39.153375 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-adf7a31a-43aa-41a7-b631-ef6c08ecda49 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:39.159602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-adf7a31a-43aa-41a7-b631-ef6c08ecda49 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.160056 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-adf7a31a-43aa-41a7-b631-ef6c08ecda49 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.160960 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-adf7a31a-43aa-41a7-b631-ef6c08ecda49 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.161405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-adf7a31a-43aa-41a7-b631-ef6c08ecda49 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.168565 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:39.169462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:39.176456 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.177338 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.178260 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.178795 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.394586 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-adf7a31a-43aa-41a7-b631-ef6c08ecda49 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:39.404390 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-adf7a31a-43aa-41a7-b631-ef6c08ecda49 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1549 microversion: 2.1 time: 0.255125 Jul 28 09:12:39.405517 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 125/237] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:39 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1549 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:39.411398 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-37b60cc2-26e4-43b8-bb3c-07423337e8cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:39.412283 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-37b60cc2-26e4-43b8-bb3c-07423337e8cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:39.418929 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-37b60cc2-26e4-43b8-bb3c-07423337e8cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.419508 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-37b60cc2-26e4-43b8-bb3c-07423337e8cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.420392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-37b60cc2-26e4-43b8-bb3c-07423337e8cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.421045 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-37b60cc2-26e4-43b8-bb3c-07423337e8cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.425637 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:39.434634 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:39.436340 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:39.437610 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ab0eb17a-0965-4755-92f7-f777c8e2b0ef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.273938 Jul 28 09:12:39.438422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 113/238] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:39 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:39.443232 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4133cb05-e4ae-482c-ae8c-312b3de05374 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:39.443970 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4133cb05-e4ae-482c-ae8c-312b3de05374 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:39.451275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4133cb05-e4ae-482c-ae8c-312b3de05374 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.451994 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4133cb05-e4ae-482c-ae8c-312b3de05374 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.452976 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4133cb05-e4ae-482c-ae8c-312b3de05374 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.453621 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4133cb05-e4ae-482c-ae8c-312b3de05374 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.587778 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4133cb05-e4ae-482c-ae8c-312b3de05374 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148057 Jul 28 09:12:39.595756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 114/239] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 09:12:39 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:39.595756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-41abea6f-9286-4b17-ad63-41e226c0bfa3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:39.595756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-41abea6f-9286-4b17-ad63-41e226c0bfa3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:39.600970 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41abea6f-9286-4b17-ad63-41e226c0bfa3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.601543 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41abea6f-9286-4b17-ad63-41e226c0bfa3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.602538 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41abea6f-9286-4b17-ad63-41e226c0bfa3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:39.603081 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41abea6f-9286-4b17-ad63-41e226c0bfa3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:39.630614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-37b60cc2-26e4-43b8-bb3c-07423337e8cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:39.639940 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-37b60cc2-26e4-43b8-bb3c-07423337e8cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.232826 Jul 28 09:12:39.641248 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 126/240] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:39 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:39.754221 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-41abea6f-9286-4b17-ad63-41e226c0bfa3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:39.766323 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-41abea6f-9286-4b17-ad63-41e226c0bfa3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.173335 Jul 28 09:12:39.767364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 115/241] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:39 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:40.461882 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:40.463152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:40.473320 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:40.475952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:40.477977 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:40.478640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:40.662582 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0b568949-7ef0-40b0-bbcd-5ed4fa24806d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:40.663189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0b568949-7ef0-40b0-bbcd-5ed4fa24806d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:40.685423 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0b568949-7ef0-40b0-bbcd-5ed4fa24806d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:40.686165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0b568949-7ef0-40b0-bbcd-5ed4fa24806d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:40.687191 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0b568949-7ef0-40b0-bbcd-5ed4fa24806d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:40.687840 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0b568949-7ef0-40b0-bbcd-5ed4fa24806d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:40.851557 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:40.861192 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:40.863370 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:40.864540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-06e9d1c1-7ae2-445c-b275-b2a435218920 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.407602 Jul 28 09:12:40.865101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 127/242] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:40 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:40.871093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-afce8e68-fc45-4bf5-ad04-0278920cba60 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:40.871842 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-afce8e68-fc45-4bf5-ad04-0278920cba60 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:40.887276 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afce8e68-fc45-4bf5-ad04-0278920cba60 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:40.887952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afce8e68-fc45-4bf5-ad04-0278920cba60 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:40.889127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afce8e68-fc45-4bf5-ad04-0278920cba60 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:40.889723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afce8e68-fc45-4bf5-ad04-0278920cba60 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:41.042824 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0b568949-7ef0-40b0-bbcd-5ed4fa24806d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:41.053470 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0b568949-7ef0-40b0-bbcd-5ed4fa24806d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.392374 Jul 28 09:12:41.063517 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 116/243] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:40 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:41.217538 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-1eef783f-85a2-4559-8591-31fa6dcf658c req-4f965ead-9469-43ee-87ec-eebfe5fd5ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6936b19d-2a6d-4b60-a88f-549320d81537", "tag": "e8f10ca5-9e77-4e44-90da-226feaaaae51"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:41.227538 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-1eef783f-85a2-4559-8591-31fa6dcf658c req-4f965ead-9469-43ee-87ec-eebfe5fd5ff7 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:41.227976 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-1eef783f-85a2-4559-8591-31fa6dcf658c req-4f965ead-9469-43ee-87ec-eebfe5fd5ff7 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:41.241377 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-1eef783f-85a2-4559-8591-31fa6dcf658c req-4f965ead-9469-43ee-87ec-eebfe5fd5ff7 service nova] Creating event network-changed:e8f10ca5-9e77-4e44-90da-226feaaaae51 for instance 6936b19d-2a6d-4b60-a88f-549320d81537 on hv-cinder-85124 Jul 28 09:12:41.246656 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-1eef783f-85a2-4559-8591-31fa6dcf658c req-4f965ead-9469-43ee-87ec-eebfe5fd5ff7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032869 Jul 28 09:12:41.247257 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 117/244] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:12:41.499478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-afce8e68-fc45-4bf5-ad04-0278920cba60 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:41.510777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-afce8e68-fc45-4bf5-ad04-0278920cba60 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.644473 Jul 28 09:12:41.511656 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 128/245] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:40 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:41.887977 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:41.889511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:41.901184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:41.901635 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:41.902454 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:41.902885 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:42.086022 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5e317fa7-61b1-4e16-9bb4-6c5798ca8036 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:42.088041 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5e317fa7-61b1-4e16-9bb4-6c5798ca8036 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:42.105316 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e317fa7-61b1-4e16-9bb4-6c5798ca8036 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:42.107237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e317fa7-61b1-4e16-9bb4-6c5798ca8036 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:42.108638 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e317fa7-61b1-4e16-9bb4-6c5798ca8036 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:42.109278 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e317fa7-61b1-4e16-9bb4-6c5798ca8036 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:42.371489 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:42.384689 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:42.386255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:42.387601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a96b239a-a52d-41c9-a1c7-bfe4cc7c69c4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.504518 Jul 28 09:12:42.388636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 118/246] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:41 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:42.417171 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5e317fa7-61b1-4e16-9bb4-6c5798ca8036 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:42.428410 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5e317fa7-61b1-4e16-9bb4-6c5798ca8036 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.356872 Jul 28 09:12:42.441755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 129/247] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:42 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:42.532617 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-92ed3db4-e330-4489-b7b0-28d197e97ff8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:42.533292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-92ed3db4-e330-4489-b7b0-28d197e97ff8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:42.549493 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ed3db4-e330-4489-b7b0-28d197e97ff8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:42.550006 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ed3db4-e330-4489-b7b0-28d197e97ff8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:42.550793 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ed3db4-e330-4489-b7b0-28d197e97ff8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:42.551260 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ed3db4-e330-4489-b7b0-28d197e97ff8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:42.893620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-92ed3db4-e330-4489-b7b0-28d197e97ff8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:42.912310 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-a8f6f56b-84ad-4fe6-83a5-b3777dcf414b req-4f90aff6-c108-402d-87c2-b8087f2fd048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145d502e-eb34-435a-8b8c-2ea6264d1506", "name": "network-vif-plugged", "status": "completed", "tag": "51927101-a0e7-4577-83b1-566bb606eeb1"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:42.921773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-92ed3db4-e330-4489-b7b0-28d197e97ff8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.392933 Jul 28 09:12:42.924134 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 119/248] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:42 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:42.977208 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-a8f6f56b-84ad-4fe6-83a5-b3777dcf414b req-4f90aff6-c108-402d-87c2-b8087f2fd048 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:42.979350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-a8f6f56b-84ad-4fe6-83a5-b3777dcf414b req-4f90aff6-c108-402d-87c2-b8087f2fd048 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:43.015166 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-a8f6f56b-84ad-4fe6-83a5-b3777dcf414b req-4f90aff6-c108-402d-87c2-b8087f2fd048 service nova] Creating event network-vif-plugged:51927101-a0e7-4577-83b1-566bb606eeb1 for instance 145d502e-eb34-435a-8b8c-2ea6264d1506 on hv-cinder-85124 Jul 28 09:12:43.035702 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-a8f6f56b-84ad-4fe6-83a5-b3777dcf414b req-4f90aff6-c108-402d-87c2-b8087f2fd048 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131124 Jul 28 09:12:43.036886 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 130/249] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:12:43.419991 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:43.421347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:43.464994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-68e87437-c897-4f16-bdbf-b4bf3bd54221 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:43.466030 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-68e87437-c897-4f16-bdbf-b4bf3bd54221 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:43.474535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:43.476496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:43.479884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:43.481774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-68e87437-c897-4f16-bdbf-b4bf3bd54221 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:43.482465 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:43.487117 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-68e87437-c897-4f16-bdbf-b4bf3bd54221 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:43.488119 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-68e87437-c897-4f16-bdbf-b4bf3bd54221 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:43.492313 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-68e87437-c897-4f16-bdbf-b4bf3bd54221 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:43.776911 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:43.778924 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-68e87437-c897-4f16-bdbf-b4bf3bd54221 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:43.791257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-68e87437-c897-4f16-bdbf-b4bf3bd54221 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.336027 Jul 28 09:12:43.791728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:43.793563 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 131/250] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:43 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:43.807267 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:43.809506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4dad2c9d-2691-4645-83eb-cfd5a0b2a837 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.402356 Jul 28 09:12:43.810294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 120/251] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:43 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:43.950151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0fd926bd-25f9-4e2b-8610-9293c23cd155 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:43.950752 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0fd926bd-25f9-4e2b-8610-9293c23cd155 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:43.954448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:43.959372 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0fd926bd-25f9-4e2b-8610-9293c23cd155 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:43.959884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0fd926bd-25f9-4e2b-8610-9293c23cd155 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:43.960577 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0fd926bd-25f9-4e2b-8610-9293c23cd155 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:43.961320 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0fd926bd-25f9-4e2b-8610-9293c23cd155 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:44.116351 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0fd926bd-25f9-4e2b-8610-9293c23cd155 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:44.123841 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0fd926bd-25f9-4e2b-8610-9293c23cd155 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.177716 Jul 28 09:12:44.125889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 132/252] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:43 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:44.816378 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2e0a091f-83c3-42b3-b0e8-47e7cff100dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:44.817737 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2e0a091f-83c3-42b3-b0e8-47e7cff100dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:44.824553 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2e0a091f-83c3-42b3-b0e8-47e7cff100dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:44.825003 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2e0a091f-83c3-42b3-b0e8-47e7cff100dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:44.825763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2e0a091f-83c3-42b3-b0e8-47e7cff100dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:44.826228 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2e0a091f-83c3-42b3-b0e8-47e7cff100dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:44.834126 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:44.835049 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:44.844048 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:44.844602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:44.846410 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:44.846902 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:45.235457 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2e0a091f-83c3-42b3-b0e8-47e7cff100dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:45.235887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:45.245115 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:45.246885 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:45.247242 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2e0a091f-83c3-42b3-b0e8-47e7cff100dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.434247 Jul 28 09:12:45.248396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5fb02d2f-f95d-4ccf-a2a9-5ea2f5c1cfc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1406 microversion: 2.20 time: 0.419224 Jul 28 09:12:45.249094 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 121/253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:44 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:45.249702 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 133/254] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:44 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:12:45.254713 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-eb3495bf-22b7-41b5-9c06-0e7712969a2b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:45.255458 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-eb3495bf-22b7-41b5-9c06-0e7712969a2b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:45.261719 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eb3495bf-22b7-41b5-9c06-0e7712969a2b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:45.262295 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eb3495bf-22b7-41b5-9c06-0e7712969a2b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:45.263180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eb3495bf-22b7-41b5-9c06-0e7712969a2b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:45.263711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eb3495bf-22b7-41b5-9c06-0e7712969a2b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:45.406307 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-11422737-53dc-4e5e-982d-a9182aa47292 req-44c8d9d8-c63e-43fb-a429-49da546ac7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bbe522-65b1-4925-9da8-8691bb25acdc", "name": "network-vif-plugged", "status": "completed", "tag": "083e115f-7d9f-46a4-a9c2-332b4c7553c4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:45.416452 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-eb3495bf-22b7-41b5-9c06-0e7712969a2b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:45.424791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-eb3495bf-22b7-41b5-9c06-0e7712969a2b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.174600 Jul 28 09:12:45.425963 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 122/255] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:45 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:45.427614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-11422737-53dc-4e5e-982d-a9182aa47292 req-44c8d9d8-c63e-43fb-a429-49da546ac7f8 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:45.428070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-11422737-53dc-4e5e-982d-a9182aa47292 req-44c8d9d8-c63e-43fb-a429-49da546ac7f8 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:45.447329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-11422737-53dc-4e5e-982d-a9182aa47292 req-44c8d9d8-c63e-43fb-a429-49da546ac7f8 service nova] Creating event network-vif-plugged:083e115f-7d9f-46a4-a9c2-332b4c7553c4 for instance a8bbe522-65b1-4925-9da8-8691bb25acdc on hv-cinder-85124 Jul 28 09:12:45.462016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-11422737-53dc-4e5e-982d-a9182aa47292 req-44c8d9d8-c63e-43fb-a429-49da546ac7f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053885 Jul 28 09:12:45.462969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 134/256] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:46.273083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2f8f8fae-a384-4eb3-be11-d296b23215dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:46.273730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2f8f8fae-a384-4eb3-be11-d296b23215dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:46.276301 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:46.277695 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:46.282323 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fae-a384-4eb3-be11-d296b23215dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:46.282942 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fae-a384-4eb3-be11-d296b23215dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:46.283708 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fae-a384-4eb3-be11-d296b23215dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:46.284281 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fae-a384-4eb3-be11-d296b23215dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:46.284763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:46.285379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:46.286485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:46.286931 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:46.541362 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:46.550345 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2f8f8fae-a384-4eb3-be11-d296b23215dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:46.553870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:46.560764 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:46.566802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2f8f8fae-a384-4eb3-be11-d296b23215dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.298646 Jul 28 09:12:46.567929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 123/257] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:46 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:46.572464 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f26d7e5b-600d-45f7-8edc-e6f1a5df5615 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:46.573331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f26d7e5b-600d-45f7-8edc-e6f1a5df5615 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:46.575848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:46.577051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-01f879b7-c557-45f1-874b-a329be5bb8ae tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1598 microversion: 2.20 time: 0.305347 Jul 28 09:12:46.577627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 135/258] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:12:46 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1598 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:12:46.594205 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f26d7e5b-600d-45f7-8edc-e6f1a5df5615 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:46.594788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f26d7e5b-600d-45f7-8edc-e6f1a5df5615 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:46.595611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f26d7e5b-600d-45f7-8edc-e6f1a5df5615 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:46.596203 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f26d7e5b-600d-45f7-8edc-e6f1a5df5615 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:46.601883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d66a5265-0867-4df2-ba88-1a28764e4361 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:46.602479 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d66a5265-0867-4df2-ba88-1a28764e4361 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:46.611254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d66a5265-0867-4df2-ba88-1a28764e4361 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:46.612195 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d66a5265-0867-4df2-ba88-1a28764e4361 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:46.613466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d66a5265-0867-4df2-ba88-1a28764e4361 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:46.614893 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d66a5265-0867-4df2-ba88-1a28764e4361 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:46.791727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d66a5265-0867-4df2-ba88-1a28764e4361 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194102 Jul 28 09:12:46.792571 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 136/259] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 09:12:46 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:12:46.865377 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f26d7e5b-600d-45f7-8edc-e6f1a5df5615 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:46.873091 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f26d7e5b-600d-45f7-8edc-e6f1a5df5615 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.304160 Jul 28 09:12:46.874633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 124/260] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:46 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:47.598027 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b45a69d6-68b9-4504-80ca-4d8d32a8e91f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:47.599446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b45a69d6-68b9-4504-80ca-4d8d32a8e91f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:47.608291 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b45a69d6-68b9-4504-80ca-4d8d32a8e91f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:47.609247 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b45a69d6-68b9-4504-80ca-4d8d32a8e91f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:47.611057 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b45a69d6-68b9-4504-80ca-4d8d32a8e91f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:47.611514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b45a69d6-68b9-4504-80ca-4d8d32a8e91f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:47.803641 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b45a69d6-68b9-4504-80ca-4d8d32a8e91f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:47.817545 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b45a69d6-68b9-4504-80ca-4d8d32a8e91f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.224048 Jul 28 09:12:47.818006 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 137/261] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:47 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:47.896283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-486e0bec-6d38-4d2e-bd7e-74fd60031fd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:47.898016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-486e0bec-6d38-4d2e-bd7e-74fd60031fd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:47.907047 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-486e0bec-6d38-4d2e-bd7e-74fd60031fd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:47.907931 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-486e0bec-6d38-4d2e-bd7e-74fd60031fd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:47.909017 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-486e0bec-6d38-4d2e-bd7e-74fd60031fd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:47.909564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-486e0bec-6d38-4d2e-bd7e-74fd60031fd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:48.101484 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-486e0bec-6d38-4d2e-bd7e-74fd60031fd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:48.111385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-486e0bec-6d38-4d2e-bd7e-74fd60031fd9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.220036 Jul 28 09:12:48.112389 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 125/262] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:47 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:48.168345 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-3ebb6f4f-23fa-4580-93a4-b7e8ae66b456 req-2e5544b8-3ce5-4cd9-baa4-6e78cfc38f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145d502e-eb34-435a-8b8c-2ea6264d1506", "tag": "51927101-a0e7-4577-83b1-566bb606eeb1"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:48.169355 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-3ebb6f4f-23fa-4580-93a4-b7e8ae66b456 req-2e5544b8-3ce5-4cd9-baa4-6e78cfc38f76 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:48.169877 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-3ebb6f4f-23fa-4580-93a4-b7e8ae66b456 req-2e5544b8-3ce5-4cd9-baa4-6e78cfc38f76 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:48.182922 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-3ebb6f4f-23fa-4580-93a4-b7e8ae66b456 req-2e5544b8-3ce5-4cd9-baa4-6e78cfc38f76 service nova] Creating event network-changed:51927101-a0e7-4577-83b1-566bb606eeb1 for instance 145d502e-eb34-435a-8b8c-2ea6264d1506 on hv-cinder-85124 Jul 28 09:12:48.188951 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-3ebb6f4f-23fa-4580-93a4-b7e8ae66b456 req-2e5544b8-3ce5-4cd9-baa4-6e78cfc38f76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034111 Jul 28 09:12:48.190350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 138/263] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:48.839451 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-489175e2-ea57-4457-9154-806f115e00a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:48.840754 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-489175e2-ea57-4457-9154-806f115e00a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:48.861673 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-489175e2-ea57-4457-9154-806f115e00a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:48.862130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-489175e2-ea57-4457-9154-806f115e00a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:48.862902 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-489175e2-ea57-4457-9154-806f115e00a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:48.863332 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-489175e2-ea57-4457-9154-806f115e00a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:49.028243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-489175e2-ea57-4457-9154-806f115e00a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:49.037082 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-489175e2-ea57-4457-9154-806f115e00a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.201469 Jul 28 09:12:49.037723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 126/264] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:48 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:49.133792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8914363c-5bea-42fa-8eb2-8e88c16d5e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:49.134516 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8914363c-5bea-42fa-8eb2-8e88c16d5e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:49.143165 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8914363c-5bea-42fa-8eb2-8e88c16d5e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:49.143737 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8914363c-5bea-42fa-8eb2-8e88c16d5e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:49.144779 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8914363c-5bea-42fa-8eb2-8e88c16d5e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:49.145338 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8914363c-5bea-42fa-8eb2-8e88c16d5e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:49.343010 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8914363c-5bea-42fa-8eb2-8e88c16d5e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:49.355264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:49.360465 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8914363c-5bea-42fa-8eb2-8e88c16d5e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.231545 Jul 28 09:12:49.361548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 139/265] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:49 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:50.057879 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b1521228-b233-4cb6-adee-c24787878929 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:50.058490 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b1521228-b233-4cb6-adee-c24787878929 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:50.064999 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b1521228-b233-4cb6-adee-c24787878929 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:50.065630 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b1521228-b233-4cb6-adee-c24787878929 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:50.066614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b1521228-b233-4cb6-adee-c24787878929 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:50.067274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b1521228-b233-4cb6-adee-c24787878929 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:50.325382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b1521228-b233-4cb6-adee-c24787878929 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:50.334170 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b1521228-b233-4cb6-adee-c24787878929 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1364 microversion: 2.1 time: 0.280188 Jul 28 09:12:50.334908 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 127/266] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:50 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:50.383116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a0933c15-926f-43fd-8729-e3fe5a3c1574 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:50.383722 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a0933c15-926f-43fd-8729-e3fe5a3c1574 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:50.390482 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a0933c15-926f-43fd-8729-e3fe5a3c1574 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:50.390482 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a0933c15-926f-43fd-8729-e3fe5a3c1574 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:50.391222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a0933c15-926f-43fd-8729-e3fe5a3c1574 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:50.391657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a0933c15-926f-43fd-8729-e3fe5a3c1574 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:50.538526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a0933c15-926f-43fd-8729-e3fe5a3c1574 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:50.548279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a0933c15-926f-43fd-8729-e3fe5a3c1574 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.169677 Jul 28 09:12:50.549466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 140/267] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:50 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:51.059190 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b687b737-b368-4f2b-90f4-ad23ce3e5e5a tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:51.060264 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b687b737-b368-4f2b-90f4-ad23ce3e5e5a tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:51.068550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b687b737-b368-4f2b-90f4-ad23ce3e5e5a tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.069073 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b687b737-b368-4f2b-90f4-ad23ce3e5e5a tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.070099 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b687b737-b368-4f2b-90f4-ad23ce3e5e5a tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.070717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b687b737-b368-4f2b-90f4-ad23ce3e5e5a tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.101662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b687b737-b368-4f2b-90f4-ad23ce3e5e5a tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:12:51.224206 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b687b737-b368-4f2b-90f4-ad23ce3e5e5a tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 204 len: 0 microversion: 2.1 time: 0.169231 Jul 28 09:12:51.225379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 128/268] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:12:51 2022] DELETE /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:12:51.233522 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9a87c342-8c06-4158-8da9-f56b8babbb6d tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:51.234733 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9a87c342-8c06-4158-8da9-f56b8babbb6d tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:51.244929 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a87c342-8c06-4158-8da9-f56b8babbb6d tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.246012 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a87c342-8c06-4158-8da9-f56b8babbb6d tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.247155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a87c342-8c06-4158-8da9-f56b8babbb6d tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.247917 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a87c342-8c06-4158-8da9-f56b8babbb6d tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.355972 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c727a0e4-d349-4aba-a415-bcbdb09b7607 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:51.356911 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c727a0e4-d349-4aba-a415-bcbdb09b7607 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:51.364044 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c727a0e4-d349-4aba-a415-bcbdb09b7607 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.364803 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c727a0e4-d349-4aba-a415-bcbdb09b7607 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.365581 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c727a0e4-d349-4aba-a415-bcbdb09b7607 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.366298 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c727a0e4-d349-4aba-a415-bcbdb09b7607 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.694974 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9a87c342-8c06-4158-8da9-f56b8babbb6d tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:51.705167 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9a87c342-8c06-4158-8da9-f56b8babbb6d tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1554 microversion: 2.1 time: 0.475506 Jul 28 09:12:51.706157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 141/269] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:51 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1554 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:51.711675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8839254f-9efd-4921-a376-f10476b0b4be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:51.712538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8839254f-9efd-4921-a376-f10476b0b4be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:51.728203 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8839254f-9efd-4921-a376-f10476b0b4be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.729235 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8839254f-9efd-4921-a376-f10476b0b4be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.730567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8839254f-9efd-4921-a376-f10476b0b4be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.731063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8839254f-9efd-4921-a376-f10476b0b4be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.740200 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c727a0e4-d349-4aba-a415-bcbdb09b7607 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:51.769401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c727a0e4-d349-4aba-a415-bcbdb09b7607 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1554 microversion: 2.1 time: 0.417473 Jul 28 09:12:51.770973 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 129/270] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:51 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1554 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:51.793752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c1816dd2-ebfe-4825-8e84-1812c472d415 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:51.794282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c1816dd2-ebfe-4825-8e84-1812c472d415 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:51.808102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1816dd2-ebfe-4825-8e84-1812c472d415 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.808674 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1816dd2-ebfe-4825-8e84-1812c472d415 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:51.809655 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1816dd2-ebfe-4825-8e84-1812c472d415 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:51.810131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1816dd2-ebfe-4825-8e84-1812c472d415 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:52.012690 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8839254f-9efd-4921-a376-f10476b0b4be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:52.022935 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8839254f-9efd-4921-a376-f10476b0b4be tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.315508 Jul 28 09:12:52.023523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 142/271] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:51 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:52.052528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c1816dd2-ebfe-4825-8e84-1812c472d415 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263554 Jul 28 09:12:52.053424 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 130/272] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 09:12:51 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:52.731995 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7c5608f1-7665-4785-a851-09fc6aa946c7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:52.733327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7c5608f1-7665-4785-a851-09fc6aa946c7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:52.743317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7c5608f1-7665-4785-a851-09fc6aa946c7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:52.744199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7c5608f1-7665-4785-a851-09fc6aa946c7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:52.745495 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7c5608f1-7665-4785-a851-09fc6aa946c7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:52.746268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7c5608f1-7665-4785-a851-09fc6aa946c7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:53.046193 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b78d65d6-ace3-401d-9228-09bc87d548eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:53.047028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b78d65d6-ace3-401d-9228-09bc87d548eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:53.054162 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b78d65d6-ace3-401d-9228-09bc87d548eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:53.054609 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b78d65d6-ace3-401d-9228-09bc87d548eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:53.055445 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b78d65d6-ace3-401d-9228-09bc87d548eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:53.055983 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b78d65d6-ace3-401d-9228-09bc87d548eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:53.462138 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7c5608f1-7665-4785-a851-09fc6aa946c7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:53.470296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7c5608f1-7665-4785-a851-09fc6aa946c7 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1554 microversion: 2.1 time: 0.743996 Jul 28 09:12:53.470899 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 143/273] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:52 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1554 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:53.501093 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b78d65d6-ace3-401d-9228-09bc87d548eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:53.509174 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b78d65d6-ace3-401d-9228-09bc87d548eb tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.467752 Jul 28 09:12:53.509737 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 131/274] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:53 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:53.995350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-e1dca702-4b4b-4033-849f-30ac2723da75 req-d54ede16-5ffa-4cb1-9530-fe37b81ee069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bbe522-65b1-4925-9da8-8691bb25acdc", "tag": "083e115f-7d9f-46a4-a9c2-332b4c7553c4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:54.004716 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-e1dca702-4b4b-4033-849f-30ac2723da75 req-d54ede16-5ffa-4cb1-9530-fe37b81ee069 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:54.005163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-e1dca702-4b4b-4033-849f-30ac2723da75 req-d54ede16-5ffa-4cb1-9530-fe37b81ee069 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:54.016954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-e1dca702-4b4b-4033-849f-30ac2723da75 req-d54ede16-5ffa-4cb1-9530-fe37b81ee069 service nova] Creating event network-changed:083e115f-7d9f-46a4-a9c2-332b4c7553c4 for instance a8bbe522-65b1-4925-9da8-8691bb25acdc on hv-cinder-85124 Jul 28 09:12:54.022321 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-e1dca702-4b4b-4033-849f-30ac2723da75 req-d54ede16-5ffa-4cb1-9530-fe37b81ee069 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030697 Jul 28 09:12:54.023179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 144/275] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:54.492605 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0eeed737-b866-4f47-9c48-433f0b8ee484 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:54.493357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0eeed737-b866-4f47-9c48-433f0b8ee484 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:54.501033 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0eeed737-b866-4f47-9c48-433f0b8ee484 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:54.501575 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0eeed737-b866-4f47-9c48-433f0b8ee484 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:54.502473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0eeed737-b866-4f47-9c48-433f0b8ee484 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:54.502970 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0eeed737-b866-4f47-9c48-433f0b8ee484 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:54.530603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ab381fa0-5591-4135-810a-b0ebefc4d185 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:54.531706 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ab381fa0-5591-4135-810a-b0ebefc4d185 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:54.550484 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab381fa0-5591-4135-810a-b0ebefc4d185 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:54.550929 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab381fa0-5591-4135-810a-b0ebefc4d185 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:54.552221 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab381fa0-5591-4135-810a-b0ebefc4d185 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:54.552652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab381fa0-5591-4135-810a-b0ebefc4d185 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:55.174636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0eeed737-b866-4f47-9c48-433f0b8ee484 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:55.183061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0eeed737-b866-4f47-9c48-433f0b8ee484 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1554 microversion: 2.1 time: 0.694811 Jul 28 09:12:55.183646 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 132/276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:54 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1554 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:55.188309 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1169113748", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "networks": [{"uuid": "78a3977d-7878-4e03-89cc-75c224db685b"}]}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:55.211535 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ab381fa0-5591-4135-810a-b0ebefc4d185 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:55.241076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ab381fa0-5591-4135-810a-b0ebefc4d185 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.715185 Jul 28 09:12:55.241665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 145/277] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:54 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:55.272354 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] validate_networks() for [('78a3977d-7878-4e03-89cc-75c224db685b', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:12:55.349060 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-181480683", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "networks": [{"uuid": "cb35dd40-bdfb-4501-b560-84079bfe68cc"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:55.406242 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] validate_networks() for [('cb35dd40-bdfb-4501-b560-84079bfe68cc', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:12:55.970773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:12:55.971283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:12:55.971632 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:12:55.972083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:12:55.972483 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:12:55.981243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:55.981683 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:55.982506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:55.982968 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.000371 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Getting quotas for project 707034727c6c44eb8cea2f5951ac48b7. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:12:56.005010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Getting quotas for user 99c077c212f1472d85df56c05a51ceb9 and project 707034727c6c44eb8cea2f5951ac48b7. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:12:56.010025 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:12:56.010452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:12:56.010929 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:12:56.011335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:12:56.011746 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:12:56.016366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:12:56.018633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:12:56.021060 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:56.021505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.022337 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:56.022772 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.039245 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Getting quotas for project 39a7fbb2f3ca405bbaa394825b4a3e73. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:12:56.043250 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Getting quotas for user 79e4add99b984c25b04553927bed7cb5 and project 39a7fbb2f3ca405bbaa394825b4a3e73. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:12:56.055497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:12:56.058128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:12:56.066145 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c57beca1-a0a7-4109-81f1-dfb44db5955a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881290 Jul 28 09:12:56.073181 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 133/278] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:12:56.073181 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-dfaa1eb7-7d9e-49e8-ae74-e124a60ff0d0 req-c9b2b965-2282-4e78-ae23-39cd75749449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc9da7bb-30df-49b1-849e-3988d86d320a", "name": "network-vif-deleted", "tag": "9b0abbfa-2bf0-4a40-b6c5-74e95957cb76"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:12:56.084212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-dfaa1eb7-7d9e-49e8-ae74-e124a60ff0d0 req-c9b2b965-2282-4e78-ae23-39cd75749449 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:56.084820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-dfaa1eb7-7d9e-49e8-ae74-e124a60ff0d0 req-c9b2b965-2282-4e78-ae23-39cd75749449 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.096496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-dfaa1eb7-7d9e-49e8-ae74-e124a60ff0d0 req-c9b2b965-2282-4e78-ae23-39cd75749449 service nova] Creating event network-vif-deleted:9b0abbfa-2bf0-4a40-b6c5-74e95957cb76 for instance fc9da7bb-30df-49b1-849e-3988d86d320a on hv-cinder-85124 Jul 28 09:12:56.101768 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-dfaa1eb7-7d9e-49e8-ae74-e124a60ff0d0 req-c9b2b965-2282-4e78-ae23-39cd75749449 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033177 Jul 28 09:12:56.103331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 134/279] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:12:56.111060 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-664af2e6-83a1-4fc7-ac20-2f8593cfeee8 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:56.112026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-664af2e6-83a1-4fc7-ac20-2f8593cfeee8 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:56.136928 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-543e9422-bbb7-425b-ac5f-0833c8189ec1 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792221 Jul 28 09:12:56.148428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 146/280] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 09:12:56.153759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f078d628-5a2b-4c40-8b41-0bc724ac3fbc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:56.154591 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f078d628-5a2b-4c40-8b41-0bc724ac3fbc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:56.175781 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-664af2e6-83a1-4fc7-ac20-2f8593cfeee8 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:56.185017 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-664af2e6-83a1-4fc7-ac20-2f8593cfeee8 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1214 microversion: 2.1 time: 0.080002 Jul 28 09:12:56.199464 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 135/281] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:56 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:56.205119 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:56.205731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:56.216248 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:56.216694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.221341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:56.221795 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.261831 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f078d628-5a2b-4c40-8b41-0bc724ac3fbc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:56.269602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f078d628-5a2b-4c40-8b41-0bc724ac3fbc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1218 microversion: 2.1 time: 0.120101 Jul 28 09:12:56.279372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:56.280106 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.281256 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lazy-loading 'fault' on Instance uuid fc9da7bb-30df-49b1-849e-3988d86d320a {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:12:56.284102 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 147/282] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:56 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:56.292745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f24c4fae-9d4c-42be-b869-995518f0e438 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:56.294853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f24c4fae-9d4c-42be-b869-995518f0e438 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:56.303846 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f24c4fae-9d4c-42be-b869-995518f0e438 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:56.304806 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f24c4fae-9d4c-42be-b869-995518f0e438 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.305903 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f24c4fae-9d4c-42be-b869-995518f0e438 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:56.306583 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f24c4fae-9d4c-42be-b869-995518f0e438 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:56.342170 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816bcf956bb442e39ff9feb7e606dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0c305435a042aabbb61816788d7c66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:56.351518 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a635d901-3083-4666-9963-ec50f43fd8b6 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 200 len: 1305 microversion: 2.1 time: 0.150357 Jul 28 09:12:56.352910 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 136/283] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:56 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:56.488590 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f24c4fae-9d4c-42be-b869-995518f0e438 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:56.497379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f24c4fae-9d4c-42be-b869-995518f0e438 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.211503 Jul 28 09:12:56.498262 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 148/284] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:56 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:57.210628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-88a33534-8868-467d-bf9b-88ca1681b262 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:57.211272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-88a33534-8868-467d-bf9b-88ca1681b262 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:57.217709 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-88a33534-8868-467d-bf9b-88ca1681b262 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.218982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-88a33534-8868-467d-bf9b-88ca1681b262 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.219837 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-88a33534-8868-467d-bf9b-88ca1681b262 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.220748 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-88a33534-8868-467d-bf9b-88ca1681b262 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.288062 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-88a33534-8868-467d-bf9b-88ca1681b262 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:57.296063 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-88a33534-8868-467d-bf9b-88ca1681b262 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1266 microversion: 2.1 time: 0.089954 Jul 28 09:12:57.296805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 137/285] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:57 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:57.297315 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e2a1165f-b074-43e4-baa2-235ca44f7923 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:57.297963 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e2a1165f-b074-43e4-baa2-235ca44f7923 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:57.305961 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2a1165f-b074-43e4-baa2-235ca44f7923 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.306409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2a1165f-b074-43e4-baa2-235ca44f7923 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.307454 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2a1165f-b074-43e4-baa2-235ca44f7923 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.308074 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2a1165f-b074-43e4-baa2-235ca44f7923 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.374570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:57.375261 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:57.382144 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.382660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.383254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2a1165f-b074-43e4-baa2-235ca44f7923 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:57.383576 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.384216 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.393220 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e2a1165f-b074-43e4-baa2-235ca44f7923 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1270 microversion: 2.1 time: 0.100695 Jul 28 09:12:57.393830 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 149/286] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:57 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:57.399484 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] HTTP exception thrown: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Request method failure captured: Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a HTTP/1.1 Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK7kKX5t52-KqoAgBUs8lAG2b89WRD8ALTyAd-Nza4zPmRm7MzkizuUpghqcalLKcQ11xC7OMCY5PksHsmjOh7ZYRMeeB6PTzA-v2FKCFo8TNU9bCQWK7i7i-BKY-mwl-jRGL02u5jQXTnDg1D-Fn1_VGI0NP3OkxqczaQaNIbMESk Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: ba0c305435a042aabbb61816788d7c66 Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:12:57.404137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba0c305435a042aabbb61816788d7c66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba0c305435a042aabbb61816788d7c66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba0c305435a042aabbb61816788d7c66", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba0c305435a042aabbb61816788d7c66"}]}] Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: ba0c305435a042aabbb61816788d7c66 Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-DeleteServersTestJSON-1086476587-project Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 816bcf956bb442e39ff9feb7e606dab4 Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-DeleteServersTestJSON-1086476587-project Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.405604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'fc9da7bb-30df-49b1-849e-3988d86d320a'} Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:12:57.406509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.407882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.409161 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Returning 404 to user: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:12:57.409161 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d5a227e8-de9b-4585-84e5-772f0b535f8c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 404 len: 111 microversion: 2.1 time: 0.036396 Jul 28 09:12:57.409161 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 138/287] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:57 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:12:57.518775 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5078604f-d208-4768-8207-a8c880edd95b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:57.518972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:57.519382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5078604f-d208-4768-8207-a8c880edd95b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:57.521140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:57.525625 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5078604f-d208-4768-8207-a8c880edd95b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.526194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5078604f-d208-4768-8207-a8c880edd95b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.527001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5078604f-d208-4768-8207-a8c880edd95b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.527280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.527441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5078604f-d208-4768-8207-a8c880edd95b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.527844 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.528472 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:57.528905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:57.541382 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] HTTP exception thrown: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Request method failure captured: Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a/os-volume_attachments HTTP/1.1 Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lK7kKX5t52-KqoAgBUs8lAG2b89WRD8ALTyAd-Nza4zPmRm7MzkizuUpghqcalLKcQ11xC7OMCY5PksHsmjOh7ZYRMeeB6PTzA-v2FKCFo8TNU9bCQWK7i7i-BKY-mwl-jRGL02u5jQXTnDg1D-Fn1_VGI0NP3OkxqczaQaNIbMESk Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: ba0c305435a042aabbb61816788d7c66 Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:12:57.548581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba0c305435a042aabbb61816788d7c66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba0c305435a042aabbb61816788d7c66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba0c305435a042aabbb61816788d7c66", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba0c305435a042aabbb61816788d7c66"}]}] Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: ba0c305435a042aabbb61816788d7c66 Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-DeleteServersTestJSON-1086476587-project Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: 816bcf956bb442e39ff9feb7e606dab4 Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-DeleteServersTestJSON-1086476587-project Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.550085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'server_id': 'fc9da7bb-30df-49b1-849e-3988d86d320a'} Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:12:57.550851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:57.552584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:12:57.553832 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Returning 404 to user: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:12:57.553832 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-17b6c86e-bb11-4aff-92e7-c4d46f54a224 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035094 Jul 28 09:12:57.553832 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 150/288] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:12:57 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:12:57.747446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5078604f-d208-4768-8207-a8c880edd95b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:57.765476 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5078604f-d208-4768-8207-a8c880edd95b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.249104 Jul 28 09:12:57.767909 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 139/289] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:57 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:58.321091 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9713a46a-6b48-4c5d-bb11-418d8d769117 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:58.321725 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9713a46a-6b48-4c5d-bb11-418d8d769117 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:58.328365 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9713a46a-6b48-4c5d-bb11-418d8d769117 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:58.328800 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9713a46a-6b48-4c5d-bb11-418d8d769117 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:58.329554 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9713a46a-6b48-4c5d-bb11-418d8d769117 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:58.330011 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9713a46a-6b48-4c5d-bb11-418d8d769117 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:58.414583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-41094fd2-3004-46a1-8cdd-10f44488b9ba tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:58.416097 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-41094fd2-3004-46a1-8cdd-10f44488b9ba tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:58.423167 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41094fd2-3004-46a1-8cdd-10f44488b9ba tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:58.423614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41094fd2-3004-46a1-8cdd-10f44488b9ba tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:58.424460 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41094fd2-3004-46a1-8cdd-10f44488b9ba tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:58.424895 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41094fd2-3004-46a1-8cdd-10f44488b9ba tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:58.436330 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9713a46a-6b48-4c5d-bb11-418d8d769117 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:58.445288 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9713a46a-6b48-4c5d-bb11-418d8d769117 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1272 microversion: 2.1 time: 0.128642 Jul 28 09:12:58.445867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 151/290] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:58 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:58.526559 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-41094fd2-3004-46a1-8cdd-10f44488b9ba tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:58.534297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-41094fd2-3004-46a1-8cdd-10f44488b9ba tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1276 microversion: 2.1 time: 0.123750 Jul 28 09:12:58.534868 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 140/291] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:58 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:12:58.792502 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ed877b04-fb60-4231-aa36-8728a62bd78c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:58.793110 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ed877b04-fb60-4231-aa36-8728a62bd78c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:58.799107 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed877b04-fb60-4231-aa36-8728a62bd78c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:58.799784 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed877b04-fb60-4231-aa36-8728a62bd78c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:58.800687 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed877b04-fb60-4231-aa36-8728a62bd78c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:58.802082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed877b04-fb60-4231-aa36-8728a62bd78c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:58.816316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:58.816819 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:58.823720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:58.824075 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:58.825077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:58.825655 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:58.987466 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] HTTP exception thrown: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Request method failure captured: Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: DELETE /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a HTTP/1.1 Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK7kKX5t52-KqoAgBUs8lAG2b89WRD8ALTyAd-Nza4zPmRm7MzkizuUpghqcalLKcQ11xC7OMCY5PksHsmjOh7ZYRMeeB6PTzA-v2FKCFo8TNU9bCQWK7i7i-BKY-mwl-jRGL02u5jQXTnDg1D-Fn1_VGI0NP3OkxqczaQaNIbMESk Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: ba0c305435a042aabbb61816788d7c66 Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:12:58.989665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba0c305435a042aabbb61816788d7c66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba0c305435a042aabbb61816788d7c66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba0c305435a042aabbb61816788d7c66", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba0c305435a042aabbb61816788d7c66"}]}] Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: ba0c305435a042aabbb61816788d7c66 Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-DeleteServersTestJSON-1086476587-project Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 816bcf956bb442e39ff9feb7e606dab4 Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-DeleteServersTestJSON-1086476587-project Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:58.991163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'fc9da7bb-30df-49b1-849e-3988d86d320a'} Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:12:58.991873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:58.992900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:58.993982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Returning 404 to user: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:12:58.993982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-df8d1b9a-0b14-4037-a519-866d11d873f9 tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 404 len: 111 microversion: 2.1 time: 0.178736 Jul 28 09:12:58.993982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 141/292] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:12:58 2022] DELETE /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:12:58.999166 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:58.999764 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] [instance: fc9da7bb-30df-49b1-849e-3988d86d320a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:59.006279 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:59.006724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:59.007539 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:59.008046 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:59.021422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] HTTP exception thrown: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Request method failure captured: Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a HTTP/1.1 Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK7kKX5t52-KqoAgBUs8lAG2b89WRD8ALTyAd-Nza4zPmRm7MzkizuUpghqcalLKcQ11xC7OMCY5PksHsmjOh7ZYRMeeB6PTzA-v2FKCFo8TNU9bCQWK7i7i-BKY-mwl-jRGL02u5jQXTnDg1D-Fn1_VGI0NP3OkxqczaQaNIbMESk Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: ba0c305435a042aabbb61816788d7c66 Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:12:59.022965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba0c305435a042aabbb61816788d7c66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba0c305435a042aabbb61816788d7c66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba0c305435a042aabbb61816788d7c66", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba0c305435a042aabbb61816788d7c66"}]}] Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: ba0c305435a042aabbb61816788d7c66 Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1086476587 Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-DeleteServersTestJSON-1086476587-project Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 816bcf956bb442e39ff9feb7e606dab4 Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-DeleteServersTestJSON-1086476587-project Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:59.024342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'fc9da7bb-30df-49b1-849e-3988d86d320a'} Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:12:59.028638 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. Jul 28 09:12:59.030348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:12:59.031596 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] Returning 404 to user: Instance fc9da7bb-30df-49b1-849e-3988d86d320a could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:12:59.031596 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-489b70b9-7541-4ee8-ab1e-7430e2fc067c tempest-DeleteServersTestJSON-1086476587 tempest-DeleteServersTestJSON-1086476587-project] 10.222.0.48 "GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a" status: 404 len: 111 microversion: 2.1 time: 0.028812 Jul 28 09:12:59.031596 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 142/293] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:58 2022] GET /compute/v2.1/servers/fc9da7bb-30df-49b1-849e-3988d86d320a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:12:59.326755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ed877b04-fb60-4231-aa36-8728a62bd78c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:12:59.337039 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ed877b04-fb60-4231-aa36-8728a62bd78c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.548051 Jul 28 09:12:59.351827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 152/294] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:58 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:12:59.466756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1796a63b-4d1c-4ec7-881a-2ddeb3a7f9c4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:59.467505 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1796a63b-4d1c-4ec7-881a-2ddeb3a7f9c4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:59.474670 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1796a63b-4d1c-4ec7-881a-2ddeb3a7f9c4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:59.475709 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1796a63b-4d1c-4ec7-881a-2ddeb3a7f9c4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:59.476588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1796a63b-4d1c-4ec7-881a-2ddeb3a7f9c4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:59.477284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1796a63b-4d1c-4ec7-881a-2ddeb3a7f9c4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:59.494849 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:59.557296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cebedb17-919a-4532-bdff-1161f4d0fa98 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:12:59.558336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cebedb17-919a-4532-bdff-1161f4d0fa98 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:12:59.564378 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cebedb17-919a-4532-bdff-1161f4d0fa98 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:59.565071 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cebedb17-919a-4532-bdff-1161f4d0fa98 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:12:59.565991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cebedb17-919a-4532-bdff-1161f4d0fa98 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:12:59.566520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cebedb17-919a-4532-bdff-1161f4d0fa98 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:00.128366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1796a63b-4d1c-4ec7-881a-2ddeb3a7f9c4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:00.144728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1796a63b-4d1c-4ec7-881a-2ddeb3a7f9c4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.678504 Jul 28 09:13:00.147037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 143/295] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:59 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:00.184285 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cebedb17-919a-4532-bdff-1161f4d0fa98 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:00.196786 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cebedb17-919a-4532-bdff-1161f4d0fa98 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.644349 Jul 28 09:13:00.197295 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 153/296] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:12:59 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:00.359789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-64a70fa9-e766-42a3-ae07-8e9e2d7d8969 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:00.360753 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-64a70fa9-e766-42a3-ae07-8e9e2d7d8969 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:00.367487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64a70fa9-e766-42a3-ae07-8e9e2d7d8969 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:00.368272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64a70fa9-e766-42a3-ae07-8e9e2d7d8969 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:00.369248 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64a70fa9-e766-42a3-ae07-8e9e2d7d8969 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:00.370085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64a70fa9-e766-42a3-ae07-8e9e2d7d8969 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:00.537315 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-f0c9cd42-0867-45ef-bf19-0c114ce3fe41 req-f8a86fb0-f021-4853-af18-ad4bafca685b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0e61cb-4814-4dce-9647-ed67031ab2a2", "tag": "85fbd8cd-d394-472b-9a95-10d15e63c17a"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:00.548216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f0c9cd42-0867-45ef-bf19-0c114ce3fe41 req-f8a86fb0-f021-4853-af18-ad4bafca685b service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:00.548920 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f0c9cd42-0867-45ef-bf19-0c114ce3fe41 req-f8a86fb0-f021-4853-af18-ad4bafca685b service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:00.565605 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-f0c9cd42-0867-45ef-bf19-0c114ce3fe41 req-f8a86fb0-f021-4853-af18-ad4bafca685b service nova] Creating event network-changed:85fbd8cd-d394-472b-9a95-10d15e63c17a for instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 on hv-cinder-85124 Jul 28 09:13:00.571331 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-f0c9cd42-0867-45ef-bf19-0c114ce3fe41 req-f8a86fb0-f021-4853-af18-ad4bafca685b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038225 Jul 28 09:13:00.572513 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 154/297] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:13:00.693809 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-64a70fa9-e766-42a3-ae07-8e9e2d7d8969 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:00.701981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-64a70fa9-e766-42a3-ae07-8e9e2d7d8969 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.346173 Jul 28 09:13:00.716043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 144/298] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:00 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:01.167217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-462a53fe-4f70-4b02-9aa8-cdbc892cce87 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:01.168114 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-462a53fe-4f70-4b02-9aa8-cdbc892cce87 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:01.175376 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-462a53fe-4f70-4b02-9aa8-cdbc892cce87 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:01.175954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-462a53fe-4f70-4b02-9aa8-cdbc892cce87 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:01.177670 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-462a53fe-4f70-4b02-9aa8-cdbc892cce87 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:01.178272 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-462a53fe-4f70-4b02-9aa8-cdbc892cce87 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:01.218634 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7ea722b0-0cf2-4931-894e-aeea2ffd1a54 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:01.219419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7ea722b0-0cf2-4931-894e-aeea2ffd1a54 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:01.227225 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ea722b0-0cf2-4931-894e-aeea2ffd1a54 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:01.228090 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ea722b0-0cf2-4931-894e-aeea2ffd1a54 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:01.229092 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ea722b0-0cf2-4931-894e-aeea2ffd1a54 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:01.229741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ea722b0-0cf2-4931-894e-aeea2ffd1a54 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:01.505932 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-462a53fe-4f70-4b02-9aa8-cdbc892cce87 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:01.513098 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7ea722b0-0cf2-4931-894e-aeea2ffd1a54 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:01.515936 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-462a53fe-4f70-4b02-9aa8-cdbc892cce87 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.353013 Jul 28 09:13:01.516546 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 155/299] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:01 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:01.521669 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7ea722b0-0cf2-4931-894e-aeea2ffd1a54 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.306920 Jul 28 09:13:01.522274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 145/300] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:01 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:01.729749 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-564fc5cc-4d3f-4107-a645-a79b20276d01 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:01.730393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-564fc5cc-4d3f-4107-a645-a79b20276d01 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:01.742710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-564fc5cc-4d3f-4107-a645-a79b20276d01 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:01.743161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-564fc5cc-4d3f-4107-a645-a79b20276d01 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:01.743992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-564fc5cc-4d3f-4107-a645-a79b20276d01 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:01.744375 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-564fc5cc-4d3f-4107-a645-a79b20276d01 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:01.892597 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-564fc5cc-4d3f-4107-a645-a79b20276d01 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:01.900084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-564fc5cc-4d3f-4107-a645-a79b20276d01 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.178045 Jul 28 09:13:01.900637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 156/301] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:01 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:02.538747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-927e6a62-fb8e-407f-967e-7ef019c24e7d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:02.539468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-927e6a62-fb8e-407f-967e-7ef019c24e7d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:02.546921 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fec025f5-bc27-41da-ae9e-2729721f9548 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:02.547533 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fec025f5-bc27-41da-ae9e-2729721f9548 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:02.554973 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fec025f5-bc27-41da-ae9e-2729721f9548 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:02.555470 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fec025f5-bc27-41da-ae9e-2729721f9548 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:02.556237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fec025f5-bc27-41da-ae9e-2729721f9548 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:02.556668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fec025f5-bc27-41da-ae9e-2729721f9548 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:02.564082 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-927e6a62-fb8e-407f-967e-7ef019c24e7d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:02.566010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-927e6a62-fb8e-407f-967e-7ef019c24e7d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:02.567331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-927e6a62-fb8e-407f-967e-7ef019c24e7d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:02.570393 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-927e6a62-fb8e-407f-967e-7ef019c24e7d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:02.768336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fec025f5-bc27-41da-ae9e-2729721f9548 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:02.772816 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-927e6a62-fb8e-407f-967e-7ef019c24e7d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:02.777614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fec025f5-bc27-41da-ae9e-2729721f9548 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.238699 Jul 28 09:13:02.778213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 157/302] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:02 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:02.784835 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-b935676b-24a8-4d76-a886-6129cc4bce31 req-ee2a5d37-92ad-454e-aa39-99671433686e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8cfe61-231d-4a5f-a2df-76954e9e9385", "tag": "1b378db7-2753-45d5-9a61-6ce631da79d2"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:02.795173 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b935676b-24a8-4d76-a886-6129cc4bce31 req-ee2a5d37-92ad-454e-aa39-99671433686e service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:02.795613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b935676b-24a8-4d76-a886-6129cc4bce31 req-ee2a5d37-92ad-454e-aa39-99671433686e service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:02.799414 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-927e6a62-fb8e-407f-967e-7ef019c24e7d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.266347 Jul 28 09:13:02.800376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 146/303] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:02 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:02.806993 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-b935676b-24a8-4d76-a886-6129cc4bce31 req-ee2a5d37-92ad-454e-aa39-99671433686e service nova] Creating event network-changed:1b378db7-2753-45d5-9a61-6ce631da79d2 for instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 on hv-cinder-85124 Jul 28 09:13:02.815010 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-b935676b-24a8-4d76-a886-6129cc4bce31 req-ee2a5d37-92ad-454e-aa39-99671433686e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033372 Jul 28 09:13:02.816014 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 158/304] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:13:02.931046 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e74f5213-7324-4e36-a786-3fdd8e54e499 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:02.931650 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e74f5213-7324-4e36-a786-3fdd8e54e499 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:02.937648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e74f5213-7324-4e36-a786-3fdd8e54e499 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:02.938153 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e74f5213-7324-4e36-a786-3fdd8e54e499 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:02.938905 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e74f5213-7324-4e36-a786-3fdd8e54e499 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:02.939333 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e74f5213-7324-4e36-a786-3fdd8e54e499 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:03.079031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e74f5213-7324-4e36-a786-3fdd8e54e499 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:03.087665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e74f5213-7324-4e36-a786-3fdd8e54e499 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.170847 Jul 28 09:13:03.088252 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 147/305] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:02 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:03.799672 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-50445718-c515-4233-b692-e653100f9006 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:03.800358 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-50445718-c515-4233-b692-e653100f9006 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:03.807417 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50445718-c515-4233-b692-e653100f9006 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:03.807862 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50445718-c515-4233-b692-e653100f9006 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:03.808678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50445718-c515-4233-b692-e653100f9006 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:03.809134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50445718-c515-4233-b692-e653100f9006 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:03.822837 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e642a68a-42b0-4d36-b355-299e56d14e55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:03.823720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e642a68a-42b0-4d36-b355-299e56d14e55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:03.830283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e642a68a-42b0-4d36-b355-299e56d14e55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:03.830728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e642a68a-42b0-4d36-b355-299e56d14e55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:03.831502 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e642a68a-42b0-4d36-b355-299e56d14e55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:03.831938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e642a68a-42b0-4d36-b355-299e56d14e55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:04.064313 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-50445718-c515-4233-b692-e653100f9006 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:04.072024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-50445718-c515-4233-b692-e653100f9006 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.276721 Jul 28 09:13:04.086407 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 159/306] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:03 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:04.108174 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-86d8bf19-6ba9-42ad-8eb2-65a8bf9eaefe tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:04.108989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-86d8bf19-6ba9-42ad-8eb2-65a8bf9eaefe tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:04.114915 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86d8bf19-6ba9-42ad-8eb2-65a8bf9eaefe tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:04.115358 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86d8bf19-6ba9-42ad-8eb2-65a8bf9eaefe tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:04.116113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86d8bf19-6ba9-42ad-8eb2-65a8bf9eaefe tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:04.116559 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86d8bf19-6ba9-42ad-8eb2-65a8bf9eaefe tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:04.146100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e642a68a-42b0-4d36-b355-299e56d14e55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:04.158810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e642a68a-42b0-4d36-b355-299e56d14e55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.340942 Jul 28 09:13:04.159709 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 148/307] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:03 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:04.460563 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-86d8bf19-6ba9-42ad-8eb2-65a8bf9eaefe tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:04.464229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:04.469770 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-86d8bf19-6ba9-42ad-8eb2-65a8bf9eaefe tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.365404 Jul 28 09:13:04.470444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 160/308] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:04 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:05.095018 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-22d8c6e0-58af-4967-957d-e523b1e96084 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:05.095621 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-22d8c6e0-58af-4967-957d-e523b1e96084 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:05.101598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-22d8c6e0-58af-4967-957d-e523b1e96084 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:05.102076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-22d8c6e0-58af-4967-957d-e523b1e96084 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:05.102833 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-22d8c6e0-58af-4967-957d-e523b1e96084 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:05.103265 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-22d8c6e0-58af-4967-957d-e523b1e96084 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:05.180350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d9360236-b2dc-4a52-b719-18422bb28324 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:05.180878 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d9360236-b2dc-4a52-b719-18422bb28324 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:05.186789 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d9360236-b2dc-4a52-b719-18422bb28324 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:05.187242 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d9360236-b2dc-4a52-b719-18422bb28324 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:05.188002 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d9360236-b2dc-4a52-b719-18422bb28324 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:05.188433 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d9360236-b2dc-4a52-b719-18422bb28324 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:05.244564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-22d8c6e0-58af-4967-957d-e523b1e96084 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:05.253325 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-22d8c6e0-58af-4967-957d-e523b1e96084 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.162626 Jul 28 09:13:05.254100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 149/309] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:05 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:05.331783 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d9360236-b2dc-4a52-b719-18422bb28324 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:05.339188 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d9360236-b2dc-4a52-b719-18422bb28324 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.163265 Jul 28 09:13:05.339751 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 161/310] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:05 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:05.492067 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5adb62b7-bf1a-4ab7-88c3-a28e40ede209 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:05.492675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5adb62b7-bf1a-4ab7-88c3-a28e40ede209 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:05.494699 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:05.500339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5adb62b7-bf1a-4ab7-88c3-a28e40ede209 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:05.500786 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5adb62b7-bf1a-4ab7-88c3-a28e40ede209 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:05.501548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5adb62b7-bf1a-4ab7-88c3-a28e40ede209 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:05.502020 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5adb62b7-bf1a-4ab7-88c3-a28e40ede209 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:05.628376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5adb62b7-bf1a-4ab7-88c3-a28e40ede209 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:05.636756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5adb62b7-bf1a-4ab7-88c3-a28e40ede209 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.149680 Jul 28 09:13:05.637321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 150/311] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:05 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:06.274971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-35cba5b8-a024-4783-b7f4-f107c3719289 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:06.275604 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-35cba5b8-a024-4783-b7f4-f107c3719289 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:06.277408 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:06.278120 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=8 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:06.283610 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35cba5b8-a024-4783-b7f4-f107c3719289 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:06.284081 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35cba5b8-a024-4783-b7f4-f107c3719289 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:06.284839 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35cba5b8-a024-4783-b7f4-f107c3719289 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:06.285269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35cba5b8-a024-4783-b7f4-f107c3719289 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:06.360553 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6cbf8fe6-926a-4b06-81a0-7928af1a89e4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:06.360936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6cbf8fe6-926a-4b06-81a0-7928af1a89e4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:06.362546 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:06.364354 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=8 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:06.370654 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6cbf8fe6-926a-4b06-81a0-7928af1a89e4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:06.371101 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6cbf8fe6-926a-4b06-81a0-7928af1a89e4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:06.371871 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6cbf8fe6-926a-4b06-81a0-7928af1a89e4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:06.372306 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6cbf8fe6-926a-4b06-81a0-7928af1a89e4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:06.421551 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-35cba5b8-a024-4783-b7f4-f107c3719289 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:06.429326 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-35cba5b8-a024-4783-b7f4-f107c3719289 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.158145 Jul 28 09:13:06.429892 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 162/312] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:06 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:06.502148 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6cbf8fe6-926a-4b06-81a0-7928af1a89e4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:06.510171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6cbf8fe6-926a-4b06-81a0-7928af1a89e4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.153991 Jul 28 09:13:06.510732 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 151/313] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:06 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:06.657363 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-25b65e5c-913b-4a4b-a9e2-29f4f99e753b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:06.658000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-25b65e5c-913b-4a4b-a9e2-29f4f99e753b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:06.663866 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-25b65e5c-913b-4a4b-a9e2-29f4f99e753b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:06.664307 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-25b65e5c-913b-4a4b-a9e2-29f4f99e753b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:06.665051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-25b65e5c-913b-4a4b-a9e2-29f4f99e753b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:06.665481 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-25b65e5c-913b-4a4b-a9e2-29f4f99e753b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:06.792691 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-25b65e5c-913b-4a4b-a9e2-29f4f99e753b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:06.800056 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-25b65e5c-913b-4a4b-a9e2-29f4f99e753b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.146462 Jul 28 09:13:06.800614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 163/314] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:06 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:07.450513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b4fed4c4-23d8-41e7-9de7-246fc2143ee9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:07.451446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b4fed4c4-23d8-41e7-9de7-246fc2143ee9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:07.459185 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b4fed4c4-23d8-41e7-9de7-246fc2143ee9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:07.459963 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b4fed4c4-23d8-41e7-9de7-246fc2143ee9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:07.460742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b4fed4c4-23d8-41e7-9de7-246fc2143ee9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:07.461344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b4fed4c4-23d8-41e7-9de7-246fc2143ee9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:07.531620 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d0bab91c-4333-42f2-92f9-96c3d9b9159a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:07.534740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d0bab91c-4333-42f2-92f9-96c3d9b9159a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:07.550406 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d0bab91c-4333-42f2-92f9-96c3d9b9159a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:07.551178 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d0bab91c-4333-42f2-92f9-96c3d9b9159a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:07.551969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d0bab91c-4333-42f2-92f9-96c3d9b9159a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:07.552569 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d0bab91c-4333-42f2-92f9-96c3d9b9159a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:07.703053 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b4fed4c4-23d8-41e7-9de7-246fc2143ee9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:07.711307 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b4fed4c4-23d8-41e7-9de7-246fc2143ee9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.265029 Jul 28 09:13:07.724354 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 152/315] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:07 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:07.728976 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-c35eb762-f109-4b06-9cf9-587204fc2dfc req-2b03dc83-a166-4365-8bb1-033e360dbecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0e61cb-4814-4dce-9647-ed67031ab2a2", "name": "network-vif-plugged", "status": "completed", "tag": "85fbd8cd-d394-472b-9a95-10d15e63c17a"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:07.738860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-c35eb762-f109-4b06-9cf9-587204fc2dfc req-2b03dc83-a166-4365-8bb1-033e360dbecb service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:07.739308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-c35eb762-f109-4b06-9cf9-587204fc2dfc req-2b03dc83-a166-4365-8bb1-033e360dbecb service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:07.750481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-c35eb762-f109-4b06-9cf9-587204fc2dfc req-2b03dc83-a166-4365-8bb1-033e360dbecb service nova] Creating event network-vif-plugged:85fbd8cd-d394-472b-9a95-10d15e63c17a for instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 on hv-cinder-85124 Jul 28 09:13:07.757870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-c35eb762-f109-4b06-9cf9-587204fc2dfc req-2b03dc83-a166-4365-8bb1-033e360dbecb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030919 Jul 28 09:13:07.757870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 153/316] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:13:07.773448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d0bab91c-4333-42f2-92f9-96c3d9b9159a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:07.781216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d0bab91c-4333-42f2-92f9-96c3d9b9159a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.254251 Jul 28 09:13:07.781779 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 164/317] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:07 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:07.822893 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-94ee77af-77f6-47e4-be42-d885dd6d71fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:07.823988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-94ee77af-77f6-47e4-be42-d885dd6d71fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:07.830375 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94ee77af-77f6-47e4-be42-d885dd6d71fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:07.830913 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94ee77af-77f6-47e4-be42-d885dd6d71fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:07.831752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94ee77af-77f6-47e4-be42-d885dd6d71fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:07.832313 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94ee77af-77f6-47e4-be42-d885dd6d71fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:07.967639 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-94ee77af-77f6-47e4-be42-d885dd6d71fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:07.976102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-94ee77af-77f6-47e4-be42-d885dd6d71fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.157462 Jul 28 09:13:07.976661 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 154/318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:07 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:08.731839 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5a8d93c3-6a93-4b3e-b90c-4ba1c94efb31 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:08.732478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5a8d93c3-6a93-4b3e-b90c-4ba1c94efb31 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:08.738312 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5a8d93c3-6a93-4b3e-b90c-4ba1c94efb31 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:08.738796 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5a8d93c3-6a93-4b3e-b90c-4ba1c94efb31 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:08.739560 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5a8d93c3-6a93-4b3e-b90c-4ba1c94efb31 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:08.739993 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5a8d93c3-6a93-4b3e-b90c-4ba1c94efb31 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:08.802587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-fa701225-22fd-4204-b25b-5791d793106b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:08.803334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-fa701225-22fd-4204-b25b-5791d793106b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:08.810772 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fa701225-22fd-4204-b25b-5791d793106b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:08.811995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fa701225-22fd-4204-b25b-5791d793106b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:08.813369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fa701225-22fd-4204-b25b-5791d793106b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:08.814047 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fa701225-22fd-4204-b25b-5791d793106b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:09.314380 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5a8d93c3-6a93-4b3e-b90c-4ba1c94efb31 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:09.322872 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5a8d93c3-6a93-4b3e-b90c-4ba1c94efb31 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.594831 Jul 28 09:13:09.337064 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 165/319] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:08 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:09.342130 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5c3833d3-8b43-40fe-a4d5-af513ae5816e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:09.342988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5c3833d3-8b43-40fe-a4d5-af513ae5816e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:09.349257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c3833d3-8b43-40fe-a4d5-af513ae5816e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:09.349711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c3833d3-8b43-40fe-a4d5-af513ae5816e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:09.350615 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c3833d3-8b43-40fe-a4d5-af513ae5816e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:09.351325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c3833d3-8b43-40fe-a4d5-af513ae5816e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:09.406208 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-fa701225-22fd-4204-b25b-5791d793106b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:09.415327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-fa701225-22fd-4204-b25b-5791d793106b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.617423 Jul 28 09:13:09.416211 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 155/320] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:08 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:09.638011 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5c3833d3-8b43-40fe-a4d5-af513ae5816e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:09.652866 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5c3833d3-8b43-40fe-a4d5-af513ae5816e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.313730 Jul 28 09:13:09.655000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 166/321] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:09 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:10.344025 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1e589dca-4bf3-44f5-8eec-09be16cfca23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:10.344548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1e589dca-4bf3-44f5-8eec-09be16cfca23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:10.350974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1e589dca-4bf3-44f5-8eec-09be16cfca23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:10.351422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1e589dca-4bf3-44f5-8eec-09be16cfca23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:10.352184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1e589dca-4bf3-44f5-8eec-09be16cfca23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:10.352620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1e589dca-4bf3-44f5-8eec-09be16cfca23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:10.436444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1d96f1d1-8587-44f2-bc0f-085108f73a08 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:10.437133 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1d96f1d1-8587-44f2-bc0f-085108f73a08 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:10.444199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d96f1d1-8587-44f2-bc0f-085108f73a08 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:10.444716 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d96f1d1-8587-44f2-bc0f-085108f73a08 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:10.445501 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d96f1d1-8587-44f2-bc0f-085108f73a08 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:10.446073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d96f1d1-8587-44f2-bc0f-085108f73a08 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:10.496380 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1e589dca-4bf3-44f5-8eec-09be16cfca23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:10.504637 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1e589dca-4bf3-44f5-8eec-09be16cfca23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.164376 Jul 28 09:13:10.505893 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 156/322] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:10 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:10.582929 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1d96f1d1-8587-44f2-bc0f-085108f73a08 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:10.590282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1d96f1d1-8587-44f2-bc0f-085108f73a08 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.157534 Jul 28 09:13:10.590838 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 167/323] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:10 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:10.675901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6c864703-c02d-4d30-9f4f-431e898bc75b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:10.677076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6c864703-c02d-4d30-9f4f-431e898bc75b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:10.683539 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6c864703-c02d-4d30-9f4f-431e898bc75b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:10.683985 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6c864703-c02d-4d30-9f4f-431e898bc75b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:10.684750 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6c864703-c02d-4d30-9f4f-431e898bc75b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:10.685255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6c864703-c02d-4d30-9f4f-431e898bc75b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:10.813608 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6c864703-c02d-4d30-9f4f-431e898bc75b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:10.820999 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6c864703-c02d-4d30-9f4f-431e898bc75b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1521 microversion: 2.1 time: 0.149304 Jul 28 09:13:10.821609 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 157/324] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:10 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:11.531613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-94043ede-ec37-4f06-a7ed-e1e7229180c2 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:11.532211 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-94043ede-ec37-4f06-a7ed-e1e7229180c2 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:11.538449 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-94043ede-ec37-4f06-a7ed-e1e7229180c2 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:11.538819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-94043ede-ec37-4f06-a7ed-e1e7229180c2 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:11.545732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-94043ede-ec37-4f06-a7ed-e1e7229180c2 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:11.545732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-94043ede-ec37-4f06-a7ed-e1e7229180c2 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:11.615300 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-db4a6061-226f-4d87-b336-9eb2c978adbe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:11.615864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-db4a6061-226f-4d87-b336-9eb2c978adbe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:11.622545 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-db4a6061-226f-4d87-b336-9eb2c978adbe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:11.622986 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-db4a6061-226f-4d87-b336-9eb2c978adbe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:11.623740 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-db4a6061-226f-4d87-b336-9eb2c978adbe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:11.624171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-db4a6061-226f-4d87-b336-9eb2c978adbe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:11.702859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-94043ede-ec37-4f06-a7ed-e1e7229180c2 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:11.711490 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-94043ede-ec37-4f06-a7ed-e1e7229180c2 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.183650 Jul 28 09:13:11.716711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 168/325] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:11 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:11.768343 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-db4a6061-226f-4d87-b336-9eb2c978adbe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:11.775709 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-db4a6061-226f-4d87-b336-9eb2c978adbe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.164933 Jul 28 09:13:11.776264 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 158/326] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:11 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:11.842540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-998197bc-0ec5-4c48-9851-035e6f2c8623 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:11.843149 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-998197bc-0ec5-4c48-9851-035e6f2c8623 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:11.849094 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-998197bc-0ec5-4c48-9851-035e6f2c8623 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:11.849542 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-998197bc-0ec5-4c48-9851-035e6f2c8623 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:11.850352 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-998197bc-0ec5-4c48-9851-035e6f2c8623 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:11.850789 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-998197bc-0ec5-4c48-9851-035e6f2c8623 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:11.868477 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-380f21b9-5cfc-41e0-9d59-9f1deed7106d req-3284e88b-2d7d-457d-92ff-9f268b808d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8cfe61-231d-4a5f-a2df-76954e9e9385", "name": "network-vif-plugged", "status": "completed", "tag": "1b378db7-2753-45d5-9a61-6ce631da79d2"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:11.880940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-380f21b9-5cfc-41e0-9d59-9f1deed7106d req-3284e88b-2d7d-457d-92ff-9f268b808d59 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:11.881579 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-380f21b9-5cfc-41e0-9d59-9f1deed7106d req-3284e88b-2d7d-457d-92ff-9f268b808d59 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:11.904014 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-380f21b9-5cfc-41e0-9d59-9f1deed7106d req-3284e88b-2d7d-457d-92ff-9f268b808d59 service nova] Creating event network-vif-plugged:1b378db7-2753-45d5-9a61-6ce631da79d2 for instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 on hv-cinder-85124 Jul 28 09:13:11.909247 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-380f21b9-5cfc-41e0-9d59-9f1deed7106d req-3284e88b-2d7d-457d-92ff-9f268b808d59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045645 Jul 28 09:13:11.909867 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 159/327] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:13:11.991912 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-998197bc-0ec5-4c48-9851-035e6f2c8623 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:11.999391 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-998197bc-0ec5-4c48-9851-035e6f2c8623 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1501 microversion: 2.1 time: 0.160758 Jul 28 09:13:11.999983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 169/328] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:11 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:12.019462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bc14287f-81bf-4a91-bf84-14a05596dc66 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:12.020191 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bc14287f-81bf-4a91-bf84-14a05596dc66 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:12.026548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bc14287f-81bf-4a91-bf84-14a05596dc66 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:12.027004 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bc14287f-81bf-4a91-bf84-14a05596dc66 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:12.027769 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bc14287f-81bf-4a91-bf84-14a05596dc66 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:12.028209 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bc14287f-81bf-4a91-bf84-14a05596dc66 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:12.190272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bc14287f-81bf-4a91-bf84-14a05596dc66 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:12.197740 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bc14287f-81bf-4a91-bf84-14a05596dc66 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1514 microversion: 2.1 time: 0.182417 Jul 28 09:13:12.198603 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 160/329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:12 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:12.732356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0c79e7b5-b8fa-4a71-972c-545afd94d4d3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:12.732887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0c79e7b5-b8fa-4a71-972c-545afd94d4d3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:12.739547 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0c79e7b5-b8fa-4a71-972c-545afd94d4d3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:12.739987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0c79e7b5-b8fa-4a71-972c-545afd94d4d3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:12.740745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0c79e7b5-b8fa-4a71-972c-545afd94d4d3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:12.741175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0c79e7b5-b8fa-4a71-972c-545afd94d4d3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:12.795495 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-99f12909-bd7b-45a3-985d-c83acf82216b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:12.812523 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-99f12909-bd7b-45a3-985d-c83acf82216b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:12.820137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99f12909-bd7b-45a3-985d-c83acf82216b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:12.820593 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99f12909-bd7b-45a3-985d-c83acf82216b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:12.821376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99f12909-bd7b-45a3-985d-c83acf82216b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:12.821815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99f12909-bd7b-45a3-985d-c83acf82216b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:12.825240 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:12.925824 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0c79e7b5-b8fa-4a71-972c-545afd94d4d3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:12.934118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0c79e7b5-b8fa-4a71-972c-545afd94d4d3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.205773 Jul 28 09:13:12.934810 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 170/330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:12 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:12.995757 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-99f12909-bd7b-45a3-985d-c83acf82216b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:13.004245 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-99f12909-bd7b-45a3-985d-c83acf82216b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.212612 Jul 28 09:13:13.004809 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 161/331] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:12 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:13.955667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-af4ac953-091b-4163-a9cb-499cfda61353 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:13.956286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-af4ac953-091b-4163-a9cb-499cfda61353 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:13.959005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:13.964488 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af4ac953-091b-4163-a9cb-499cfda61353 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:13.964939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af4ac953-091b-4163-a9cb-499cfda61353 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:13.965709 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af4ac953-091b-4163-a9cb-499cfda61353 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:13.966175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af4ac953-091b-4163-a9cb-499cfda61353 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:14.027840 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ebc92659-1dce-421d-bfcf-aedf782636e7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:14.028485 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ebc92659-1dce-421d-bfcf-aedf782636e7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:14.035019 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ebc92659-1dce-421d-bfcf-aedf782636e7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:14.036136 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ebc92659-1dce-421d-bfcf-aedf782636e7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:14.036923 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ebc92659-1dce-421d-bfcf-aedf782636e7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:14.037366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ebc92659-1dce-421d-bfcf-aedf782636e7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:14.140583 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-af4ac953-091b-4163-a9cb-499cfda61353 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:14.148627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-af4ac953-091b-4163-a9cb-499cfda61353 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.197047 Jul 28 09:13:14.149388 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 171/332] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:13 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:14.184484 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ebc92659-1dce-421d-bfcf-aedf782636e7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:14.192433 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ebc92659-1dce-421d-bfcf-aedf782636e7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.168317 Jul 28 09:13:14.192992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 162/333] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:14 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:15.170254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-65fb0ebc-c633-4cd9-99c3-193d00b11347 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:15.170862 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-65fb0ebc-c633-4cd9-99c3-193d00b11347 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:15.177566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-65fb0ebc-c633-4cd9-99c3-193d00b11347 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:15.178335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-65fb0ebc-c633-4cd9-99c3-193d00b11347 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:15.179675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-65fb0ebc-c633-4cd9-99c3-193d00b11347 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:15.180124 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-65fb0ebc-c633-4cd9-99c3-193d00b11347 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:15.214812 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2416cbcd-5f6a-4279-b145-b1c8648862d4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:15.215495 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2416cbcd-5f6a-4279-b145-b1c8648862d4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:15.222265 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2416cbcd-5f6a-4279-b145-b1c8648862d4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:15.222717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2416cbcd-5f6a-4279-b145-b1c8648862d4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:15.224011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2416cbcd-5f6a-4279-b145-b1c8648862d4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:15.224423 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2416cbcd-5f6a-4279-b145-b1c8648862d4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:15.367101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-65fb0ebc-c633-4cd9-99c3-193d00b11347 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:15.374580 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-65fb0ebc-c633-4cd9-99c3-193d00b11347 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.208119 Jul 28 09:13:15.375348 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 172/334] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:15 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:15.392761 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2416cbcd-5f6a-4279-b145-b1c8648862d4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:15.400561 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2416cbcd-5f6a-4279-b145-b1c8648862d4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1314 microversion: 2.1 time: 0.190763 Jul 28 09:13:15.401120 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 163/335] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:15 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:16.394308 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-349e8e6f-1d9f-4407-848e-ef705549f71e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:16.394916 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-349e8e6f-1d9f-4407-848e-ef705549f71e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:16.401717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-349e8e6f-1d9f-4407-848e-ef705549f71e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:16.402224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-349e8e6f-1d9f-4407-848e-ef705549f71e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:16.403239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-349e8e6f-1d9f-4407-848e-ef705549f71e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:16.403680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-349e8e6f-1d9f-4407-848e-ef705549f71e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:16.420860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c703631e-9bb6-4d51-87e1-3f75f2bf03bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:16.421462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c703631e-9bb6-4d51-87e1-3f75f2bf03bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:16.428686 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c703631e-9bb6-4d51-87e1-3f75f2bf03bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:16.429128 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c703631e-9bb6-4d51-87e1-3f75f2bf03bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:16.429917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c703631e-9bb6-4d51-87e1-3f75f2bf03bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:16.430341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c703631e-9bb6-4d51-87e1-3f75f2bf03bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:16.642116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-349e8e6f-1d9f-4407-848e-ef705549f71e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:16.648996 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c703631e-9bb6-4d51-87e1-3f75f2bf03bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:16.649395 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-349e8e6f-1d9f-4407-848e-ef705549f71e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.258882 Jul 28 09:13:16.649979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 173/336] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:16 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:16.656717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c703631e-9bb6-4d51-87e1-3f75f2bf03bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1498 microversion: 2.1 time: 0.239674 Jul 28 09:13:16.657271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 164/337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:16 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:17.366024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-199c95ff-ea18-44e5-afab-d16b4a038e72 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:17.366523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-199c95ff-ea18-44e5-afab-d16b4a038e72 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:17.372435 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-199c95ff-ea18-44e5-afab-d16b4a038e72 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.372884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-199c95ff-ea18-44e5-afab-d16b4a038e72 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.373645 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-199c95ff-ea18-44e5-afab-d16b4a038e72 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.374106 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-199c95ff-ea18-44e5-afab-d16b4a038e72 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.398922 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-199c95ff-ea18-44e5-afab-d16b4a038e72 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:13:17.482765 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-199c95ff-ea18-44e5-afab-d16b4a038e72 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 204 len: 0 microversion: 2.1 time: 0.120256 Jul 28 09:13:17.483347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 174/338] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:13:17 2022] DELETE /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:13:17.491392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5530244e-7dd7-4f02-8e19-d861b2f9ff55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:17.491992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5530244e-7dd7-4f02-8e19-d861b2f9ff55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:17.498482 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5530244e-7dd7-4f02-8e19-d861b2f9ff55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.498924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5530244e-7dd7-4f02-8e19-d861b2f9ff55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.499694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5530244e-7dd7-4f02-8e19-d861b2f9ff55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.500129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5530244e-7dd7-4f02-8e19-d861b2f9ff55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.625832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5530244e-7dd7-4f02-8e19-d861b2f9ff55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:17.634758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5530244e-7dd7-4f02-8e19-d861b2f9ff55 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.146759 Jul 28 09:13:17.635787 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 165/339] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:17 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:17.670688 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-72107018-4a97-47b7-9883-565d3e8c1487 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:17.671377 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-72107018-4a97-47b7-9883-565d3e8c1487 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:17.677874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-72107018-4a97-47b7-9883-565d3e8c1487 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.678325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-72107018-4a97-47b7-9883-565d3e8c1487 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.679073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-72107018-4a97-47b7-9883-565d3e8c1487 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.679503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-72107018-4a97-47b7-9883-565d3e8c1487 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.780657 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-01c7cf5e-8e76-4415-a534-fc19298fd149 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:17.783131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-01c7cf5e-8e76-4415-a534-fc19298fd149 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:17.789925 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-01c7cf5e-8e76-4415-a534-fc19298fd149 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.790376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-01c7cf5e-8e76-4415-a534-fc19298fd149 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.791144 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-01c7cf5e-8e76-4415-a534-fc19298fd149 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.791584 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-01c7cf5e-8e76-4415-a534-fc19298fd149 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.807347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-72107018-4a97-47b7-9883-565d3e8c1487 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:17.811379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:17.817122 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-72107018-4a97-47b7-9883-565d3e8c1487 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.150503 Jul 28 09:13:17.817693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 175/340] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:17 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:17.826326 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-01c7cf5e-8e76-4415-a534-fc19298fd149 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lazy-loading 'flavor' on Instance uuid 25e208af-ae8f-482f-b140-66e820fb9f4c {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:13:17.934304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-01c7cf5e-8e76-4415-a534-fc19298fd149 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c/action" status: 200 len: 32 microversion: 2.1 time: 0.157498 Jul 28 09:13:17.934933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 166/341] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:13:17 2022] POST /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:13:17.945696 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cff4e4b3-ca65-4bfe-9834-e8f66d30827a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:17.946322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cff4e4b3-ca65-4bfe-9834-e8f66d30827a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:17.953771 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cff4e4b3-ca65-4bfe-9834-e8f66d30827a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.954237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cff4e4b3-ca65-4bfe-9834-e8f66d30827a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:17.954986 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cff4e4b3-ca65-4bfe-9834-e8f66d30827a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:17.955416 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cff4e4b3-ca65-4bfe-9834-e8f66d30827a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:18.083337 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cff4e4b3-ca65-4bfe-9834-e8f66d30827a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:18.090695 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cff4e4b3-ca65-4bfe-9834-e8f66d30827a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.150189 Jul 28 09:13:18.091726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 176/342] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:17 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:18.657267 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-43a21f93-f3d8-4d70-9e86-eb6c14c552a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:18.657981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-43a21f93-f3d8-4d70-9e86-eb6c14c552a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:18.664811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-43a21f93-f3d8-4d70-9e86-eb6c14c552a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:18.665256 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-43a21f93-f3d8-4d70-9e86-eb6c14c552a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:18.666041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-43a21f93-f3d8-4d70-9e86-eb6c14c552a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:18.666475 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-43a21f93-f3d8-4d70-9e86-eb6c14c552a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:18.793399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-43a21f93-f3d8-4d70-9e86-eb6c14c552a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:18.800827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-43a21f93-f3d8-4d70-9e86-eb6c14c552a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.148230 Jul 28 09:13:18.802087 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 167/343] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:18 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:18.837888 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-959e1096-2076-4053-8e86-5a91f7507b11 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:18.838491 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-959e1096-2076-4053-8e86-5a91f7507b11 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:18.844500 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-959e1096-2076-4053-8e86-5a91f7507b11 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:18.844942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-959e1096-2076-4053-8e86-5a91f7507b11 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:18.845694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-959e1096-2076-4053-8e86-5a91f7507b11 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:18.846147 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-959e1096-2076-4053-8e86-5a91f7507b11 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:18.973622 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-959e1096-2076-4053-8e86-5a91f7507b11 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:18.980976 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-959e1096-2076-4053-8e86-5a91f7507b11 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.146919 Jul 28 09:13:18.981708 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 177/344] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:18 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:19.111306 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bbc1f086-9b66-45c3-9320-3d87be852acf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:19.111910 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bbc1f086-9b66-45c3-9320-3d87be852acf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:19.117863 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bbc1f086-9b66-45c3-9320-3d87be852acf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:19.118318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bbc1f086-9b66-45c3-9320-3d87be852acf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:19.119072 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bbc1f086-9b66-45c3-9320-3d87be852acf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:19.119510 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bbc1f086-9b66-45c3-9320-3d87be852acf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:19.243395 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bbc1f086-9b66-45c3-9320-3d87be852acf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:19.250712 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bbc1f086-9b66-45c3-9320-3d87be852acf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.143298 Jul 28 09:13:19.251266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 168/345] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:19 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:19.823225 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9e66b41f-6e59-4cf2-8355-6d73940f3d3c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:19.824079 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9e66b41f-6e59-4cf2-8355-6d73940f3d3c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:19.830049 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e66b41f-6e59-4cf2-8355-6d73940f3d3c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:19.830493 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e66b41f-6e59-4cf2-8355-6d73940f3d3c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:19.831297 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e66b41f-6e59-4cf2-8355-6d73940f3d3c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:19.831726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e66b41f-6e59-4cf2-8355-6d73940f3d3c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:19.958865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9e66b41f-6e59-4cf2-8355-6d73940f3d3c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:19.966249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9e66b41f-6e59-4cf2-8355-6d73940f3d3c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.146893 Jul 28 09:13:19.966803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 178/346] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:19 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:20.002225 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-57a6ba06-d5fe-4042-ad23-b791e5c351cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:20.002932 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-57a6ba06-d5fe-4042-ad23-b791e5c351cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:20.009266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-57a6ba06-d5fe-4042-ad23-b791e5c351cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:20.009682 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-57a6ba06-d5fe-4042-ad23-b791e5c351cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:20.010467 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-57a6ba06-d5fe-4042-ad23-b791e5c351cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:20.010903 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-57a6ba06-d5fe-4042-ad23-b791e5c351cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:20.139718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-57a6ba06-d5fe-4042-ad23-b791e5c351cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:20.147514 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-57a6ba06-d5fe-4042-ad23-b791e5c351cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.149050 Jul 28 09:13:20.148072 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 169/347] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:19 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:20.271954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-07101896-3f2b-476d-947b-0116ff30c0fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:20.272583 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-07101896-3f2b-476d-947b-0116ff30c0fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:20.278465 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07101896-3f2b-476d-947b-0116ff30c0fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:20.278910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07101896-3f2b-476d-947b-0116ff30c0fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:20.279655 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07101896-3f2b-476d-947b-0116ff30c0fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:20.280083 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07101896-3f2b-476d-947b-0116ff30c0fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:20.405887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-07101896-3f2b-476d-947b-0116ff30c0fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:20.413465 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-07101896-3f2b-476d-947b-0116ff30c0fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.145909 Jul 28 09:13:20.414046 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 179/348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:20 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:20.987659 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-68ec5f47-22f5-42ee-90e2-9fdff26158ee tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:20.988268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-68ec5f47-22f5-42ee-90e2-9fdff26158ee tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:20.994973 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-68ec5f47-22f5-42ee-90e2-9fdff26158ee tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:20.995416 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-68ec5f47-22f5-42ee-90e2-9fdff26158ee tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:20.996162 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-68ec5f47-22f5-42ee-90e2-9fdff26158ee tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:20.996586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-68ec5f47-22f5-42ee-90e2-9fdff26158ee tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:21.124736 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-68ec5f47-22f5-42ee-90e2-9fdff26158ee tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:21.132077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-68ec5f47-22f5-42ee-90e2-9fdff26158ee tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.148266 Jul 28 09:13:21.132635 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 170/349] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:20 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:21.168308 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-210e4813-4176-44e1-a92f-fa5a9d5f74cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:21.168920 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-210e4813-4176-44e1-a92f-fa5a9d5f74cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:21.174847 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-210e4813-4176-44e1-a92f-fa5a9d5f74cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:21.175243 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-210e4813-4176-44e1-a92f-fa5a9d5f74cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:21.176627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-210e4813-4176-44e1-a92f-fa5a9d5f74cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:21.177063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-210e4813-4176-44e1-a92f-fa5a9d5f74cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:21.305862 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-210e4813-4176-44e1-a92f-fa5a9d5f74cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:21.314849 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-210e4813-4176-44e1-a92f-fa5a9d5f74cf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.150231 Jul 28 09:13:21.315489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 180/350] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:21 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:21.434405 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-90d438c0-e07c-47a7-8bb6-2df28195ff57 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:21.434930 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-90d438c0-e07c-47a7-8bb6-2df28195ff57 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:21.441066 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-90d438c0-e07c-47a7-8bb6-2df28195ff57 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:21.441513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-90d438c0-e07c-47a7-8bb6-2df28195ff57 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:21.442350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-90d438c0-e07c-47a7-8bb6-2df28195ff57 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:21.442791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-90d438c0-e07c-47a7-8bb6-2df28195ff57 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:21.570715 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-90d438c0-e07c-47a7-8bb6-2df28195ff57 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:21.579172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-90d438c0-e07c-47a7-8bb6-2df28195ff57 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.148760 Jul 28 09:13:21.579763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 171/351] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:21 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:22.152121 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-11310554-c9fe-4bae-99e0-f08b49bff328 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:22.152733 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-11310554-c9fe-4bae-99e0-f08b49bff328 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:22.158654 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11310554-c9fe-4bae-99e0-f08b49bff328 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:22.159101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11310554-c9fe-4bae-99e0-f08b49bff328 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:22.159859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11310554-c9fe-4bae-99e0-f08b49bff328 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:22.160948 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11310554-c9fe-4bae-99e0-f08b49bff328 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:22.286503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-11310554-c9fe-4bae-99e0-f08b49bff328 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:22.293940 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-11310554-c9fe-4bae-99e0-f08b49bff328 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.145648 Jul 28 09:13:22.294497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 181/352] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:22 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:22.336154 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f85a1ca9-e78d-4df4-a5f9-ffa18b5b9a5e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:22.336769 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f85a1ca9-e78d-4df4-a5f9-ffa18b5b9a5e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:22.344339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f85a1ca9-e78d-4df4-a5f9-ffa18b5b9a5e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:22.344735 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f85a1ca9-e78d-4df4-a5f9-ffa18b5b9a5e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:22.345500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f85a1ca9-e78d-4df4-a5f9-ffa18b5b9a5e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:22.345970 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f85a1ca9-e78d-4df4-a5f9-ffa18b5b9a5e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:22.471413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f85a1ca9-e78d-4df4-a5f9-ffa18b5b9a5e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:22.478836 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f85a1ca9-e78d-4df4-a5f9-ffa18b5b9a5e tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.147026 Jul 28 09:13:22.479411 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 172/353] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:22 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:22.600838 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a6908a04-2791-4467-9c6a-fbcb3d3720fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:22.601725 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a6908a04-2791-4467-9c6a-fbcb3d3720fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:22.607594 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a6908a04-2791-4467-9c6a-fbcb3d3720fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:22.608033 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a6908a04-2791-4467-9c6a-fbcb3d3720fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:22.608788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a6908a04-2791-4467-9c6a-fbcb3d3720fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:22.609219 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a6908a04-2791-4467-9c6a-fbcb3d3720fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:22.737796 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a6908a04-2791-4467-9c6a-fbcb3d3720fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:22.745380 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a6908a04-2791-4467-9c6a-fbcb3d3720fa tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.148880 Jul 28 09:13:22.746000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 182/354] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:22 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:23.315372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5d266a72-86e4-4d07-9600-254425d31297 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:23.316272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5d266a72-86e4-4d07-9600-254425d31297 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:23.322265 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5d266a72-86e4-4d07-9600-254425d31297 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:23.322782 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5d266a72-86e4-4d07-9600-254425d31297 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:23.323965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5d266a72-86e4-4d07-9600-254425d31297 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:23.324400 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5d266a72-86e4-4d07-9600-254425d31297 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:23.456669 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5d266a72-86e4-4d07-9600-254425d31297 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:23.464046 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5d266a72-86e4-4d07-9600-254425d31297 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.153046 Jul 28 09:13:23.464610 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 173/355] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:23 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:23.499645 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e1a37b5c-b1d1-4360-b692-d88d7513b5bf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:23.500268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e1a37b5c-b1d1-4360-b692-d88d7513b5bf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:23.506328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e1a37b5c-b1d1-4360-b692-d88d7513b5bf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:23.506722 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e1a37b5c-b1d1-4360-b692-d88d7513b5bf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:23.507484 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e1a37b5c-b1d1-4360-b692-d88d7513b5bf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:23.507924 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e1a37b5c-b1d1-4360-b692-d88d7513b5bf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:23.637176 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e1a37b5c-b1d1-4360-b692-d88d7513b5bf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:23.645000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e1a37b5c-b1d1-4360-b692-d88d7513b5bf tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.149183 Jul 28 09:13:23.645564 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 183/356] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:23 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:23.766820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-42018c43-afa0-491b-9fb5-b44a7522c61c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:23.767340 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-42018c43-afa0-491b-9fb5-b44a7522c61c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:23.773238 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-42018c43-afa0-491b-9fb5-b44a7522c61c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:23.773690 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-42018c43-afa0-491b-9fb5-b44a7522c61c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:23.774481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-42018c43-afa0-491b-9fb5-b44a7522c61c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:23.774918 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-42018c43-afa0-491b-9fb5-b44a7522c61c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:23.902227 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-42018c43-afa0-491b-9fb5-b44a7522c61c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:23.909982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-42018c43-afa0-491b-9fb5-b44a7522c61c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.147129 Jul 28 09:13:23.910554 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 174/357] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:23 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:24.484299 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6345756d-b5ff-420e-a900-cce327ca90fe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:24.485605 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6345756d-b5ff-420e-a900-cce327ca90fe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:24.491344 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6345756d-b5ff-420e-a900-cce327ca90fe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:24.491913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6345756d-b5ff-420e-a900-cce327ca90fe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:24.492816 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6345756d-b5ff-420e-a900-cce327ca90fe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:24.493351 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6345756d-b5ff-420e-a900-cce327ca90fe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:24.667080 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b49c00c9-0683-4363-a7a3-e393144c9f24 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:24.667684 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b49c00c9-0683-4363-a7a3-e393144c9f24 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:24.677401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6345756d-b5ff-420e-a900-cce327ca90fe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:24.682189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b49c00c9-0683-4363-a7a3-e393144c9f24 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:24.682820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b49c00c9-0683-4363-a7a3-e393144c9f24 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:24.684053 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b49c00c9-0683-4363-a7a3-e393144c9f24 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:24.684632 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b49c00c9-0683-4363-a7a3-e393144c9f24 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:24.685608 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6345756d-b5ff-420e-a900-cce327ca90fe tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.205048 Jul 28 09:13:24.686204 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 184/358] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:24 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:24.834563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b49c00c9-0683-4363-a7a3-e393144c9f24 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:24.836839 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:24.844493 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b49c00c9-0683-4363-a7a3-e393144c9f24 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1318 microversion: 2.1 time: 0.181736 Jul 28 09:13:24.845088 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 175/359] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:24 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:24.931182 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ee9880f4-86c7-4673-a5fd-2665c368de02 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:24.931785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ee9880f4-86c7-4673-a5fd-2665c368de02 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:24.937613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ee9880f4-86c7-4673-a5fd-2665c368de02 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:24.938089 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ee9880f4-86c7-4673-a5fd-2665c368de02 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:24.938840 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ee9880f4-86c7-4673-a5fd-2665c368de02 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:24.939268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ee9880f4-86c7-4673-a5fd-2665c368de02 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:25.071566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ee9880f4-86c7-4673-a5fd-2665c368de02 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:25.079106 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ee9880f4-86c7-4673-a5fd-2665c368de02 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.151749 Jul 28 09:13:25.079676 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 185/360] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:24 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:25.708633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4680cf71-6bca-4f74-a2d4-7bbae2c6dae7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:25.709231 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4680cf71-6bca-4f74-a2d4-7bbae2c6dae7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:25.716586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4680cf71-6bca-4f74-a2d4-7bbae2c6dae7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:25.717029 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4680cf71-6bca-4f74-a2d4-7bbae2c6dae7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:25.717777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4680cf71-6bca-4f74-a2d4-7bbae2c6dae7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:25.718298 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4680cf71-6bca-4f74-a2d4-7bbae2c6dae7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:25.848759 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4680cf71-6bca-4f74-a2d4-7bbae2c6dae7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:25.856105 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4680cf71-6bca-4f74-a2d4-7bbae2c6dae7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.151674 Jul 28 09:13:25.856669 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 176/361] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:25 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:25.864236 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-84173149-acde-4108-98a9-5eb8be1df8b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:25.864841 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-84173149-acde-4108-98a9-5eb8be1df8b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:25.870685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-84173149-acde-4108-98a9-5eb8be1df8b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:25.871126 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-84173149-acde-4108-98a9-5eb8be1df8b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:25.872014 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-84173149-acde-4108-98a9-5eb8be1df8b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:25.872448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-84173149-acde-4108-98a9-5eb8be1df8b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:26.002557 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-84173149-acde-4108-98a9-5eb8be1df8b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:26.009991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-84173149-acde-4108-98a9-5eb8be1df8b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1507 microversion: 2.1 time: 0.149518 Jul 28 09:13:26.010547 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 186/362] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:25 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:26.100459 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cef0901e-21db-4376-9552-57a43a267fac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:26.101061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cef0901e-21db-4376-9552-57a43a267fac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:26.107331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cef0901e-21db-4376-9552-57a43a267fac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:26.107802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cef0901e-21db-4376-9552-57a43a267fac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:26.108571 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cef0901e-21db-4376-9552-57a43a267fac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:26.109008 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cef0901e-21db-4376-9552-57a43a267fac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:26.245589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cef0901e-21db-4376-9552-57a43a267fac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:26.253149 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cef0901e-21db-4376-9552-57a43a267fac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.157209 Jul 28 09:13:26.253880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 177/363] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:26 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:26.876367 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b8e67e70-fae0-4f6e-b15c-6129551b2ed0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:26.876968 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b8e67e70-fae0-4f6e-b15c-6129551b2ed0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:26.883054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b8e67e70-fae0-4f6e-b15c-6129551b2ed0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:26.883525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b8e67e70-fae0-4f6e-b15c-6129551b2ed0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:26.884281 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b8e67e70-fae0-4f6e-b15c-6129551b2ed0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:26.884705 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b8e67e70-fae0-4f6e-b15c-6129551b2ed0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:27.011611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b8e67e70-fae0-4f6e-b15c-6129551b2ed0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:27.019052 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b8e67e70-fae0-4f6e-b15c-6129551b2ed0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1504 microversion: 2.1 time: 0.146468 Jul 28 09:13:27.019642 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 187/364] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:26 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:27.275967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0f01659b-255c-4c9e-a36a-94dfd33314bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:27.276705 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0f01659b-255c-4c9e-a36a-94dfd33314bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:27.284730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0f01659b-255c-4c9e-a36a-94dfd33314bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:27.285206 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0f01659b-255c-4c9e-a36a-94dfd33314bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:27.286022 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0f01659b-255c-4c9e-a36a-94dfd33314bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:27.286459 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0f01659b-255c-4c9e-a36a-94dfd33314bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:27.717600 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0f01659b-255c-4c9e-a36a-94dfd33314bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:27.725687 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0f01659b-255c-4c9e-a36a-94dfd33314bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.453553 Jul 28 09:13:27.726284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 178/365] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:27 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:27.939506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-08d8a615-6ed9-4815-8db8-29cee0dcf7ea req-392fdead-9082-438e-9448-ade67e15b72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0e61cb-4814-4dce-9647-ed67031ab2a2", "name": "network-vif-deleted", "tag": "85fbd8cd-d394-472b-9a95-10d15e63c17a"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:27.949141 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-08d8a615-6ed9-4815-8db8-29cee0dcf7ea req-392fdead-9082-438e-9448-ade67e15b72a service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:27.949604 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-08d8a615-6ed9-4815-8db8-29cee0dcf7ea req-392fdead-9082-438e-9448-ade67e15b72a service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:27.960763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-08d8a615-6ed9-4815-8db8-29cee0dcf7ea req-392fdead-9082-438e-9448-ade67e15b72a service nova] Creating event network-vif-deleted:85fbd8cd-d394-472b-9a95-10d15e63c17a for instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 on hv-cinder-85124 Jul 28 09:13:27.966110 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-08d8a615-6ed9-4815-8db8-29cee0dcf7ea req-392fdead-9082-438e-9448-ade67e15b72a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030077 Jul 28 09:13:27.966674 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 188/366] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:13:28.040350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a5b5bc07-5e53-4ccd-b504-0d1ce00cbad4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:28.040957 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a5b5bc07-5e53-4ccd-b504-0d1ce00cbad4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:28.047137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5b5bc07-5e53-4ccd-b504-0d1ce00cbad4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:28.047627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5b5bc07-5e53-4ccd-b504-0d1ce00cbad4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:28.048395 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5b5bc07-5e53-4ccd-b504-0d1ce00cbad4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:28.048827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5b5bc07-5e53-4ccd-b504-0d1ce00cbad4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:28.111742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a5b5bc07-5e53-4ccd-b504-0d1ce00cbad4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:28.120097 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a5b5bc07-5e53-4ccd-b504-0d1ce00cbad4 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1462 microversion: 2.1 time: 0.083565 Jul 28 09:13:28.120688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 179/367] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:28 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:28.747947 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bf67cd7d-ae51-4330-adf6-25bc033f5534 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:28.748661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bf67cd7d-ae51-4330-adf6-25bc033f5534 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:28.754795 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bf67cd7d-ae51-4330-adf6-25bc033f5534 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:28.755239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bf67cd7d-ae51-4330-adf6-25bc033f5534 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:28.755987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bf67cd7d-ae51-4330-adf6-25bc033f5534 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:28.756412 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bf67cd7d-ae51-4330-adf6-25bc033f5534 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:28.883214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-bf67cd7d-ae51-4330-adf6-25bc033f5534 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:28.890606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bf67cd7d-ae51-4330-adf6-25bc033f5534 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.146900 Jul 28 09:13:28.891161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 189/368] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:28 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:29.141599 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6e41e178-335e-4cd9-86ce-4c6ae547b702 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:29.142187 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6e41e178-335e-4cd9-86ce-4c6ae547b702 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:29.149164 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e41e178-335e-4cd9-86ce-4c6ae547b702 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:29.149611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e41e178-335e-4cd9-86ce-4c6ae547b702 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:29.150397 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e41e178-335e-4cd9-86ce-4c6ae547b702 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:29.150835 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e41e178-335e-4cd9-86ce-4c6ae547b702 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:29.211840 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6e41e178-335e-4cd9-86ce-4c6ae547b702 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:29.219133 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6e41e178-335e-4cd9-86ce-4c6ae547b702 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1462 microversion: 2.1 time: 0.081454 Jul 28 09:13:29.219722 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 180/369] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:29 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:29.914343 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a590f57e-d653-4169-8c0e-230d2ca3d0f3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:29.914945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a590f57e-d653-4169-8c0e-230d2ca3d0f3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:29.921718 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a590f57e-d653-4169-8c0e-230d2ca3d0f3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:29.922315 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a590f57e-d653-4169-8c0e-230d2ca3d0f3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:29.924084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a590f57e-d653-4169-8c0e-230d2ca3d0f3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:29.924084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a590f57e-d653-4169-8c0e-230d2ca3d0f3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:30.108823 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a590f57e-d653-4169-8c0e-230d2ca3d0f3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:30.117298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a590f57e-d653-4169-8c0e-230d2ca3d0f3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.208967 Jul 28 09:13:30.117974 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 190/370] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:29 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:30.241432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:30.242784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:30.251115 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:30.251633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:30.252622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:30.253044 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:30.293499 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:30.294501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:30.294979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lazy-loading 'fault' on Instance uuid 6e0e61cb-4814-4dce-9647-ed67031ab2a2 {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:13:30.345069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:30.353636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3f2a5549-4dfd-4280-a718-6180fc473f70 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 200 len: 1304 microversion: 2.1 time: 0.117185 Jul 28 09:13:30.354465 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 181/371] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:30 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:31.138471 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-69827d71-c949-4403-a41f-666784f230b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:31.139026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-69827d71-c949-4403-a41f-666784f230b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:31.145163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69827d71-c949-4403-a41f-666784f230b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:31.145633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69827d71-c949-4403-a41f-666784f230b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:31.146438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69827d71-c949-4403-a41f-666784f230b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:31.146874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69827d71-c949-4403-a41f-666784f230b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:31.370939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-69827d71-c949-4403-a41f-666784f230b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:31.380222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-69827d71-c949-4403-a41f-666784f230b3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.245865 Jul 28 09:13:31.380461 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:31.381040 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: 6e0e61cb-4814-4dce-9647-ed67031ab2a2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:31.381120 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 191/372] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:31 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:31.387806 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:31.388255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:31.389077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:31.389457 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:31.404574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] HTTP exception thrown: Instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 could not be found. Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Request method failure captured: Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 HTTP/1.1 Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lMTEZd8M5Fw1D1W5EN4SkbJnieEnn82E_6JR8v9P34SXKs1-CxEaOJ6O3BEJpOXeh_90xqiuaQ4RY1rz03I21IdhqbCkx-5GlQIJnANeMi_Vi8fw73gFyQWry8S3OY2gr15B1UzTrhOegXtoBORkUVQDodhEuFSZgrCYH9RMbzbw-A Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 707034727c6c44eb8cea2f5951ac48b7 Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesActionsTest-1472417548 Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:13:31.406287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/707034727c6c44eb8cea2f5951ac48b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/707034727c6c44eb8cea2f5951ac48b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_707034727c6c44eb8cea2f5951ac48b7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/707034727c6c44eb8cea2f5951ac48b7"}]}] Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesActionsTest-1472417548 Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 707034727c6c44eb8cea2f5951ac48b7 Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesActionsTest-1472417548 Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesActionsTest-1472417548-project Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 99c077c212f1472d85df56c05a51ceb9 Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesActionsTest-1472417548-project Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 could not be found. Jul 28 09:13:31.407831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '6e0e61cb-4814-4dce-9647-ed67031ab2a2'} Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 could not be found. Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:13:31.408648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 could not be found. Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 could not be found. Jul 28 09:13:31.409794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:31.410987 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Returning 404 to user: Instance 6e0e61cb-4814-4dce-9647-ed67031ab2a2 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:13:31.410987 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a7ce61b1-cc87-4016-a4ca-c1e46a88358e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2" status: 404 len: 111 microversion: 2.1 time: 0.034611 Jul 28 09:13:31.410987 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 182/373] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:31 2022] GET /compute/v2.1/servers/6e0e61cb-4814-4dce-9647-ed67031ab2a2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:13:31.518172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-331377872", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "networks": [{"uuid": "78a3977d-7878-4e03-89cc-75c224db685b"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:31.573278 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] validate_networks() for [('78a3977d-7878-4e03-89cc-75c224db685b', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:13:31.987047 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:13:31.987483 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:13:31.987983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:13:31.989066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:13:31.989519 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:13:31.998499 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:31.998947 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:31.999752 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:32.000193 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:32.018494 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Getting quotas for project 707034727c6c44eb8cea2f5951ac48b7. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:13:32.022523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Getting quotas for user 99c077c212f1472d85df56c05a51ceb9 and project 707034727c6c44eb8cea2f5951ac48b7. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:13:32.034971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:13:32.037198 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:13:32.082642 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-83ede3c2-d31e-437c-8e73-ea0ee502e67e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568200 Jul 28 09:13:32.083285 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 192/374] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 09:13:32.094822 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-80930746-f2f7-49b2-ab0b-26883690c916 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:32.095048 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-80930746-f2f7-49b2-ab0b-26883690c916 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:32.155687 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-80930746-f2f7-49b2-ab0b-26883690c916 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:32.163735 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-80930746-f2f7-49b2-ab0b-26883690c916 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1213 microversion: 2.1 time: 0.073001 Jul 28 09:13:32.164367 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 183/375] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:32 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:32.406804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ab8ab5b9-2c28-4427-9698-5dc0be1e19f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:32.407558 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ab8ab5b9-2c28-4427-9698-5dc0be1e19f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:32.415075 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab8ab5b9-2c28-4427-9698-5dc0be1e19f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:32.415534 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab8ab5b9-2c28-4427-9698-5dc0be1e19f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:32.416331 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab8ab5b9-2c28-4427-9698-5dc0be1e19f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:32.416764 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab8ab5b9-2c28-4427-9698-5dc0be1e19f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:32.563665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ab8ab5b9-2c28-4427-9698-5dc0be1e19f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:32.567208 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:32.572515 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ab8ab5b9-2c28-4427-9698-5dc0be1e19f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.170793 Jul 28 09:13:32.573087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 193/376] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:32 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:33.187492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f94ff8b7-d38e-4fb6-afad-a17a05f95387 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:33.188111 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f94ff8b7-d38e-4fb6-afad-a17a05f95387 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:33.194707 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f94ff8b7-d38e-4fb6-afad-a17a05f95387 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:33.195147 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f94ff8b7-d38e-4fb6-afad-a17a05f95387 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:33.195936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f94ff8b7-d38e-4fb6-afad-a17a05f95387 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:33.196364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f94ff8b7-d38e-4fb6-afad-a17a05f95387 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:33.258871 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f94ff8b7-d38e-4fb6-afad-a17a05f95387 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:33.266316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f94ff8b7-d38e-4fb6-afad-a17a05f95387 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1209 microversion: 2.1 time: 0.084855 Jul 28 09:13:33.266868 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 184/377] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:33 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:33.594637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-90f44ecf-fa4c-45c5-9d99-90ce68ae63a3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:33.595246 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-90f44ecf-fa4c-45c5-9d99-90ce68ae63a3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:33.601452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-90f44ecf-fa4c-45c5-9d99-90ce68ae63a3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:33.601930 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-90f44ecf-fa4c-45c5-9d99-90ce68ae63a3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:33.602689 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-90f44ecf-fa4c-45c5-9d99-90ce68ae63a3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:33.603127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-90f44ecf-fa4c-45c5-9d99-90ce68ae63a3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:33.735650 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-90f44ecf-fa4c-45c5-9d99-90ce68ae63a3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:33.743738 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-90f44ecf-fa4c-45c5-9d99-90ce68ae63a3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.153095 Jul 28 09:13:33.744294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 194/378] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:33 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:34.287397 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-178be2fa-152d-4c94-9729-9955928c6d58 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:34.287981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-178be2fa-152d-4c94-9729-9955928c6d58 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:34.294547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-178be2fa-152d-4c94-9729-9955928c6d58 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:34.294993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-178be2fa-152d-4c94-9729-9955928c6d58 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:34.295747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-178be2fa-152d-4c94-9729-9955928c6d58 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:34.296180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-178be2fa-152d-4c94-9729-9955928c6d58 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:34.355061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-178be2fa-152d-4c94-9729-9955928c6d58 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:34.362468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-178be2fa-152d-4c94-9729-9955928c6d58 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1209 microversion: 2.1 time: 0.079636 Jul 28 09:13:34.363024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 185/379] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:34 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:34.766667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-243b3da3-2fbe-486a-97ef-60fdf948a1b8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:34.767311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-243b3da3-2fbe-486a-97ef-60fdf948a1b8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:34.774200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-243b3da3-2fbe-486a-97ef-60fdf948a1b8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:34.774640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-243b3da3-2fbe-486a-97ef-60fdf948a1b8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:34.775390 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-243b3da3-2fbe-486a-97ef-60fdf948a1b8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:34.775823 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-243b3da3-2fbe-486a-97ef-60fdf948a1b8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:34.904822 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-243b3da3-2fbe-486a-97ef-60fdf948a1b8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:34.912594 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-243b3da3-2fbe-486a-97ef-60fdf948a1b8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.149752 Jul 28 09:13:34.913154 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 195/380] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:34 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:35.383091 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3899166c-ef70-45a3-8463-0e290a350db2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:35.383693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3899166c-ef70-45a3-8463-0e290a350db2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:35.390275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3899166c-ef70-45a3-8463-0e290a350db2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:35.390717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3899166c-ef70-45a3-8463-0e290a350db2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:35.391465 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3899166c-ef70-45a3-8463-0e290a350db2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:35.391894 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3899166c-ef70-45a3-8463-0e290a350db2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:35.458412 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3899166c-ef70-45a3-8463-0e290a350db2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:35.467181 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3899166c-ef70-45a3-8463-0e290a350db2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1209 microversion: 2.1 time: 0.087553 Jul 28 09:13:35.467181 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 186/381] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:35 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:35.934529 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c6f704f-140a-471f-9ed0-cdea9eeac8c5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:35.935209 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c6f704f-140a-471f-9ed0-cdea9eeac8c5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:35.941192 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c6f704f-140a-471f-9ed0-cdea9eeac8c5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:35.942792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c6f704f-140a-471f-9ed0-cdea9eeac8c5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:35.943568 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c6f704f-140a-471f-9ed0-cdea9eeac8c5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:35.944005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c6f704f-140a-471f-9ed0-cdea9eeac8c5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:36.074418 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c6f704f-140a-471f-9ed0-cdea9eeac8c5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:36.084190 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c6f704f-140a-471f-9ed0-cdea9eeac8c5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.153294 Jul 28 09:13:36.084761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 196/382] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:35 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:36.487412 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-520c45e3-bb29-40bd-8d2f-96b8edc5ea6e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:36.488014 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-520c45e3-bb29-40bd-8d2f-96b8edc5ea6e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:36.491386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=78 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:36.498515 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-520c45e3-bb29-40bd-8d2f-96b8edc5ea6e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:36.498969 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-520c45e3-bb29-40bd-8d2f-96b8edc5ea6e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:36.499753 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-520c45e3-bb29-40bd-8d2f-96b8edc5ea6e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:36.500187 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-520c45e3-bb29-40bd-8d2f-96b8edc5ea6e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:36.562099 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-520c45e3-bb29-40bd-8d2f-96b8edc5ea6e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:36.570131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-520c45e3-bb29-40bd-8d2f-96b8edc5ea6e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1209 microversion: 2.1 time: 0.086858 Jul 28 09:13:36.570695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 187/383] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:36 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:37.107004 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-246c43d3-2e85-425c-abcf-c6076800cd69 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:37.107728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-246c43d3-2e85-425c-abcf-c6076800cd69 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:37.113660 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-246c43d3-2e85-425c-abcf-c6076800cd69 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:37.114152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-246c43d3-2e85-425c-abcf-c6076800cd69 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:37.114907 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-246c43d3-2e85-425c-abcf-c6076800cd69 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:37.115339 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-246c43d3-2e85-425c-abcf-c6076800cd69 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:37.242787 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-246c43d3-2e85-425c-abcf-c6076800cd69 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:37.250245 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-246c43d3-2e85-425c-abcf-c6076800cd69 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.147051 Jul 28 09:13:37.250801 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 197/384] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:37 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:37.590709 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4a2dc26b-4007-478b-8cc9-3460350ffb9a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:37.591318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4a2dc26b-4007-478b-8cc9-3460350ffb9a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:37.598006 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a2dc26b-4007-478b-8cc9-3460350ffb9a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:37.598466 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a2dc26b-4007-478b-8cc9-3460350ffb9a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:37.599228 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a2dc26b-4007-478b-8cc9-3460350ffb9a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:37.599668 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a2dc26b-4007-478b-8cc9-3460350ffb9a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:37.667790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4a2dc26b-4007-478b-8cc9-3460350ffb9a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:37.675431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4a2dc26b-4007-478b-8cc9-3460350ffb9a tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1209 microversion: 2.1 time: 0.088757 Jul 28 09:13:37.676172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 188/385] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:37 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:38.271611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-986b968b-f955-493f-b1dd-1d2dceb30a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:38.272142 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-986b968b-f955-493f-b1dd-1d2dceb30a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:38.278208 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-986b968b-f955-493f-b1dd-1d2dceb30a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:38.278658 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-986b968b-f955-493f-b1dd-1d2dceb30a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:38.279414 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-986b968b-f955-493f-b1dd-1d2dceb30a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:38.279850 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-986b968b-f955-493f-b1dd-1d2dceb30a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:38.408200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-986b968b-f955-493f-b1dd-1d2dceb30a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:38.416316 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-986b968b-f955-493f-b1dd-1d2dceb30a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.149209 Jul 28 09:13:38.416884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 198/386] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:38 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:38.696349 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-125f9cbb-91a8-48c7-8f0e-debfffb2a844 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:38.696955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-125f9cbb-91a8-48c7-8f0e-debfffb2a844 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:38.703729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-125f9cbb-91a8-48c7-8f0e-debfffb2a844 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:38.704172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-125f9cbb-91a8-48c7-8f0e-debfffb2a844 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:38.704929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-125f9cbb-91a8-48c7-8f0e-debfffb2a844 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:38.705367 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-125f9cbb-91a8-48c7-8f0e-debfffb2a844 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:38.768795 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-125f9cbb-91a8-48c7-8f0e-debfffb2a844 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:38.776969 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-125f9cbb-91a8-48c7-8f0e-debfffb2a844 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1209 microversion: 2.1 time: 0.084460 Jul 28 09:13:38.777535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 189/387] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:38 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:39.438193 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-39af029b-8485-490e-85eb-93025a6034c9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:39.438798 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-39af029b-8485-490e-85eb-93025a6034c9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:39.445746 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-39af029b-8485-490e-85eb-93025a6034c9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:39.446213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-39af029b-8485-490e-85eb-93025a6034c9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:39.446968 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-39af029b-8485-490e-85eb-93025a6034c9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:39.447396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-39af029b-8485-490e-85eb-93025a6034c9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:39.576742 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-39af029b-8485-490e-85eb-93025a6034c9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:39.584529 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-39af029b-8485-490e-85eb-93025a6034c9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.150045 Jul 28 09:13:39.595288 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 199/388] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:39 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:39.799173 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8e0507d8-05f6-4ad8-bbd6-3dfae8552d98 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:39.799913 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8e0507d8-05f6-4ad8-bbd6-3dfae8552d98 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:39.807829 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8e0507d8-05f6-4ad8-bbd6-3dfae8552d98 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:39.808276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8e0507d8-05f6-4ad8-bbd6-3dfae8552d98 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:39.809037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8e0507d8-05f6-4ad8-bbd6-3dfae8552d98 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:39.809461 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8e0507d8-05f6-4ad8-bbd6-3dfae8552d98 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:39.884015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8e0507d8-05f6-4ad8-bbd6-3dfae8552d98 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:39.891550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8e0507d8-05f6-4ad8-bbd6-3dfae8552d98 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1265 microversion: 2.1 time: 0.096779 Jul 28 09:13:39.892112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 190/389] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:39 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:40.606304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7da0b821-69f8-499d-9627-616124185b05 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:40.606911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7da0b821-69f8-499d-9627-616124185b05 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:40.613287 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7da0b821-69f8-499d-9627-616124185b05 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:40.613769 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7da0b821-69f8-499d-9627-616124185b05 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:40.614574 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7da0b821-69f8-499d-9627-616124185b05 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:40.615233 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7da0b821-69f8-499d-9627-616124185b05 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:40.856552 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7da0b821-69f8-499d-9627-616124185b05 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:40.864896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7da0b821-69f8-499d-9627-616124185b05 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.262458 Jul 28 09:13:40.865560 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 200/390] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:40 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:40.912117 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-84245fc9-790d-4ed1-b449-493687309896 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:40.912705 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-84245fc9-790d-4ed1-b449-493687309896 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:40.919693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-84245fc9-790d-4ed1-b449-493687309896 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:40.920069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-84245fc9-790d-4ed1-b449-493687309896 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:40.920828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-84245fc9-790d-4ed1-b449-493687309896 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:40.921262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-84245fc9-790d-4ed1-b449-493687309896 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:40.995228 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-84245fc9-790d-4ed1-b449-493687309896 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:41.002940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-84245fc9-790d-4ed1-b449-493687309896 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1271 microversion: 2.1 time: 0.094732 Jul 28 09:13:41.003510 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 191/391] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:40 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:41.843089 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-303ecf3d-df80-4325-bf3d-7153df178413 req-07fe5e9a-b8e0-48df-aa2c-34ebaf5df81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3317255-2cf3-4607-b66e-4304074841bb", "tag": "c1c43e9c-6a89-49b1-876d-70dd41025c51"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:41.854275 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-303ecf3d-df80-4325-bf3d-7153df178413 req-07fe5e9a-b8e0-48df-aa2c-34ebaf5df81b service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:41.854831 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-303ecf3d-df80-4325-bf3d-7153df178413 req-07fe5e9a-b8e0-48df-aa2c-34ebaf5df81b service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:41.868240 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-303ecf3d-df80-4325-bf3d-7153df178413 req-07fe5e9a-b8e0-48df-aa2c-34ebaf5df81b service nova] Creating event network-changed:c1c43e9c-6a89-49b1-876d-70dd41025c51 for instance a3317255-2cf3-4607-b66e-4304074841bb on hv-cinder-85124 Jul 28 09:13:41.874096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-303ecf3d-df80-4325-bf3d-7153df178413 req-07fe5e9a-b8e0-48df-aa2c-34ebaf5df81b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036372 Jul 28 09:13:41.874697 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 201/392] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:13:41.886637 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d842afe7-10a9-4c75-b165-bf658b3dd918 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:41.887249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d842afe7-10a9-4c75-b165-bf658b3dd918 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:41.893754 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d842afe7-10a9-4c75-b165-bf658b3dd918 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:41.894264 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d842afe7-10a9-4c75-b165-bf658b3dd918 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:41.895077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d842afe7-10a9-4c75-b165-bf658b3dd918 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:41.895726 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d842afe7-10a9-4c75-b165-bf658b3dd918 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:42.022268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:42.026961 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-58e4d5aa-7b0e-4ae3-9b91-f1845d996002 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:42.027657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-58e4d5aa-7b0e-4ae3-9b91-f1845d996002 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:42.029777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:42.036244 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58e4d5aa-7b0e-4ae3-9b91-f1845d996002 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:42.036988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58e4d5aa-7b0e-4ae3-9b91-f1845d996002 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:42.038006 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58e4d5aa-7b0e-4ae3-9b91-f1845d996002 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:42.038869 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58e4d5aa-7b0e-4ae3-9b91-f1845d996002 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:42.096256 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d842afe7-10a9-4c75-b165-bf658b3dd918 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:42.116651 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d842afe7-10a9-4c75-b165-bf658b3dd918 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.233947 Jul 28 09:13:42.117415 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 192/393] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:41 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:42.516278 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-58e4d5aa-7b0e-4ae3-9b91-f1845d996002 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:42.523931 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-58e4d5aa-7b0e-4ae3-9b91-f1845d996002 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.502812 Jul 28 09:13:42.524504 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 202/394] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:42 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:43.138133 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-353d4f43-9235-4281-906d-6022861656cc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:43.138745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-353d4f43-9235-4281-906d-6022861656cc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:43.141627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:43.145611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-353d4f43-9235-4281-906d-6022861656cc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:43.146216 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-353d4f43-9235-4281-906d-6022861656cc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:43.146836 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-353d4f43-9235-4281-906d-6022861656cc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:43.147273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-353d4f43-9235-4281-906d-6022861656cc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:43.276973 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-353d4f43-9235-4281-906d-6022861656cc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:43.279233 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:43.285943 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-353d4f43-9235-4281-906d-6022861656cc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.151626 Jul 28 09:13:43.286773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 193/395] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:43 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:43.546685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5476fe87-e0f3-4e44-aace-5f5fcd6d20de tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:43.547593 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5476fe87-e0f3-4e44-aace-5f5fcd6d20de tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:43.554451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5476fe87-e0f3-4e44-aace-5f5fcd6d20de tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:43.554891 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5476fe87-e0f3-4e44-aace-5f5fcd6d20de tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:43.555657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5476fe87-e0f3-4e44-aace-5f5fcd6d20de tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:43.556086 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5476fe87-e0f3-4e44-aace-5f5fcd6d20de tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:43.691402 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5476fe87-e0f3-4e44-aace-5f5fcd6d20de tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:43.698727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5476fe87-e0f3-4e44-aace-5f5fcd6d20de tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.156222 Jul 28 09:13:43.699549 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 203/396] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:43 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:44.308084 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bca54428-7803-441e-90cf-b56ed76fd8e3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:44.308687 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bca54428-7803-441e-90cf-b56ed76fd8e3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:44.315081 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bca54428-7803-441e-90cf-b56ed76fd8e3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:44.315534 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bca54428-7803-441e-90cf-b56ed76fd8e3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:44.316289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bca54428-7803-441e-90cf-b56ed76fd8e3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:44.316727 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bca54428-7803-441e-90cf-b56ed76fd8e3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:44.444019 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bca54428-7803-441e-90cf-b56ed76fd8e3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:44.451633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bca54428-7803-441e-90cf-b56ed76fd8e3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.147657 Jul 28 09:13:44.452196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 194/397] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:44 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:44.719266 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-736b0e42-425f-4ab1-bde9-fc6961ec47eb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:44.719829 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-736b0e42-425f-4ab1-bde9-fc6961ec47eb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:44.721672 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:44.728400 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-736b0e42-425f-4ab1-bde9-fc6961ec47eb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:44.728844 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-736b0e42-425f-4ab1-bde9-fc6961ec47eb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:44.729601 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-736b0e42-425f-4ab1-bde9-fc6961ec47eb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:44.730063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-736b0e42-425f-4ab1-bde9-fc6961ec47eb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:44.856415 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-736b0e42-425f-4ab1-bde9-fc6961ec47eb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:44.863786 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-736b0e42-425f-4ab1-bde9-fc6961ec47eb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.148375 Jul 28 09:13:44.864352 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 204/398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:44 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:45.472856 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-56c7991f-cda1-4aa5-a391-0fc82dff7cbd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:45.476559 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-56c7991f-cda1-4aa5-a391-0fc82dff7cbd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:45.483780 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-56c7991f-cda1-4aa5-a391-0fc82dff7cbd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:45.484231 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-56c7991f-cda1-4aa5-a391-0fc82dff7cbd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:45.485198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-56c7991f-cda1-4aa5-a391-0fc82dff7cbd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:45.486026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-56c7991f-cda1-4aa5-a391-0fc82dff7cbd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:45.619647 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-56c7991f-cda1-4aa5-a391-0fc82dff7cbd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:45.627725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-56c7991f-cda1-4aa5-a391-0fc82dff7cbd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.159105 Jul 28 09:13:45.628301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 195/399] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:45 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:45.884521 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-31ddff78-77d4-4665-8c5d-800bcfab7e89 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:45.885124 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-31ddff78-77d4-4665-8c5d-800bcfab7e89 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:45.891235 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-31ddff78-77d4-4665-8c5d-800bcfab7e89 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:45.891674 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-31ddff78-77d4-4665-8c5d-800bcfab7e89 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:45.892436 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-31ddff78-77d4-4665-8c5d-800bcfab7e89 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:45.892866 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-31ddff78-77d4-4665-8c5d-800bcfab7e89 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:46.027683 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-31ddff78-77d4-4665-8c5d-800bcfab7e89 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:46.035378 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-31ddff78-77d4-4665-8c5d-800bcfab7e89 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.154640 Jul 28 09:13:46.035866 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 205/400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:45 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:46.649702 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e4c0600e-e915-4330-ae1f-682bdd7fc141 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:46.650331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e4c0600e-e915-4330-ae1f-682bdd7fc141 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:46.656823 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4c0600e-e915-4330-ae1f-682bdd7fc141 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:46.657264 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4c0600e-e915-4330-ae1f-682bdd7fc141 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:46.658043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4c0600e-e915-4330-ae1f-682bdd7fc141 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:46.658474 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4c0600e-e915-4330-ae1f-682bdd7fc141 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:46.791823 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e4c0600e-e915-4330-ae1f-682bdd7fc141 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:46.799325 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e4c0600e-e915-4330-ae1f-682bdd7fc141 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.153512 Jul 28 09:13:46.799879 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 196/401] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:46 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:47.056485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-50f6f1e1-ace0-4fea-8c11-ac36841eaadc tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:47.057098 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-50f6f1e1-ace0-4fea-8c11-ac36841eaadc tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:47.063059 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50f6f1e1-ace0-4fea-8c11-ac36841eaadc tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:47.063503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50f6f1e1-ace0-4fea-8c11-ac36841eaadc tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:47.064263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50f6f1e1-ace0-4fea-8c11-ac36841eaadc tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:47.064701 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50f6f1e1-ace0-4fea-8c11-ac36841eaadc tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:47.190332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-50f6f1e1-ace0-4fea-8c11-ac36841eaadc tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:47.198371 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-50f6f1e1-ace0-4fea-8c11-ac36841eaadc tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.145710 Jul 28 09:13:47.199174 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 206/402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:47 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:47.821268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9d893aff-a8f8-41b6-b868-8f6319cd11c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:47.822465 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9d893aff-a8f8-41b6-b868-8f6319cd11c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:47.829686 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9d893aff-a8f8-41b6-b868-8f6319cd11c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:47.830163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9d893aff-a8f8-41b6-b868-8f6319cd11c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:47.830918 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9d893aff-a8f8-41b6-b868-8f6319cd11c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:47.831350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9d893aff-a8f8-41b6-b868-8f6319cd11c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:47.958588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9d893aff-a8f8-41b6-b868-8f6319cd11c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:47.966613 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9d893aff-a8f8-41b6-b868-8f6319cd11c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.149155 Jul 28 09:13:47.967178 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 197/403] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:47 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:13:48.219709 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a3bae633-54cc-4acb-a602-c61898297593 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:48.220345 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a3bae633-54cc-4acb-a602-c61898297593 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:48.226379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a3bae633-54cc-4acb-a602-c61898297593 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:48.226819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a3bae633-54cc-4acb-a602-c61898297593 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:48.227566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a3bae633-54cc-4acb-a602-c61898297593 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:48.227992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a3bae633-54cc-4acb-a602-c61898297593 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:48.358480 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a3bae633-54cc-4acb-a602-c61898297593 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:48.366249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a3bae633-54cc-4acb-a602-c61898297593 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.150299 Jul 28 09:13:48.366803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 207/404] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:48 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:48.987263 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8ea88139-0893-4ba8-bf19-2d5d25bb6b7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:48.987901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8ea88139-0893-4ba8-bf19-2d5d25bb6b7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:48.994368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8ea88139-0893-4ba8-bf19-2d5d25bb6b7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:48.994807 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8ea88139-0893-4ba8-bf19-2d5d25bb6b7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:48.995559 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8ea88139-0893-4ba8-bf19-2d5d25bb6b7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:48.995990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8ea88139-0893-4ba8-bf19-2d5d25bb6b7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:49.124802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8ea88139-0893-4ba8-bf19-2d5d25bb6b7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:49.133437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8ea88139-0893-4ba8-bf19-2d5d25bb6b7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.149970 Jul 28 09:13:49.134089 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 198/405] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:48 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:49.387285 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7d30e14c-1c08-4f40-aa46-b7d101434a4e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:49.387900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7d30e14c-1c08-4f40-aa46-b7d101434a4e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:49.393787 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d30e14c-1c08-4f40-aa46-b7d101434a4e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:49.394263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d30e14c-1c08-4f40-aa46-b7d101434a4e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:49.395026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d30e14c-1c08-4f40-aa46-b7d101434a4e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:49.395463 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d30e14c-1c08-4f40-aa46-b7d101434a4e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:49.525452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7d30e14c-1c08-4f40-aa46-b7d101434a4e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:49.532745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7d30e14c-1c08-4f40-aa46-b7d101434a4e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.149270 Jul 28 09:13:49.533308 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 208/406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:49 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:50.154678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e0e3715d-b63b-475c-8f5e-f0823d739e4f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:50.155290 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e0e3715d-b63b-475c-8f5e-f0823d739e4f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:50.162478 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e0e3715d-b63b-475c-8f5e-f0823d739e4f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:50.162929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e0e3715d-b63b-475c-8f5e-f0823d739e4f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:50.163686 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e0e3715d-b63b-475c-8f5e-f0823d739e4f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:50.164121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e0e3715d-b63b-475c-8f5e-f0823d739e4f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:50.290881 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e0e3715d-b63b-475c-8f5e-f0823d739e4f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:50.298320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e0e3715d-b63b-475c-8f5e-f0823d739e4f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.147524 Jul 28 09:13:50.298878 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 199/407] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:50 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:50.552945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-232f91ca-f44d-4722-9f4d-eb897ef466bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:50.553553 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-232f91ca-f44d-4722-9f4d-eb897ef466bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:50.559515 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-232f91ca-f44d-4722-9f4d-eb897ef466bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:50.559955 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-232f91ca-f44d-4722-9f4d-eb897ef466bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:50.560706 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-232f91ca-f44d-4722-9f4d-eb897ef466bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:50.561134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-232f91ca-f44d-4722-9f4d-eb897ef466bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:50.693341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-232f91ca-f44d-4722-9f4d-eb897ef466bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:50.700943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-232f91ca-f44d-4722-9f4d-eb897ef466bd tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.151745 Jul 28 09:13:50.701490 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 209/408] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:50 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:51.319996 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-95035c2a-2f68-4a42-b9cb-ea77178e10de tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:51.320599 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-95035c2a-2f68-4a42-b9cb-ea77178e10de tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:51.327171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-95035c2a-2f68-4a42-b9cb-ea77178e10de tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:51.327616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-95035c2a-2f68-4a42-b9cb-ea77178e10de tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:51.328368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-95035c2a-2f68-4a42-b9cb-ea77178e10de tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:51.328800 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-95035c2a-2f68-4a42-b9cb-ea77178e10de tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:51.455442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-95035c2a-2f68-4a42-b9cb-ea77178e10de tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:51.462823 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-95035c2a-2f68-4a42-b9cb-ea77178e10de tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.147327 Jul 28 09:13:51.463421 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 200/409] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:51 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:51.726201 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1d31a11c-f638-4a98-85e5-f2d7d5efe48e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:51.726201 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1d31a11c-f638-4a98-85e5-f2d7d5efe48e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:51.730336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d31a11c-f638-4a98-85e5-f2d7d5efe48e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:51.730833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d31a11c-f638-4a98-85e5-f2d7d5efe48e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:51.731594 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d31a11c-f638-4a98-85e5-f2d7d5efe48e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:51.732190 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d31a11c-f638-4a98-85e5-f2d7d5efe48e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:51.862506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1d31a11c-f638-4a98-85e5-f2d7d5efe48e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:51.871141 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1d31a11c-f638-4a98-85e5-f2d7d5efe48e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.153715 Jul 28 09:13:51.871700 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 210/410] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:51 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:52.484392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cb71fa65-e715-4338-a736-19129971dc0e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:52.485019 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cb71fa65-e715-4338-a736-19129971dc0e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:52.491481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cb71fa65-e715-4338-a736-19129971dc0e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:52.491931 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cb71fa65-e715-4338-a736-19129971dc0e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:52.492693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cb71fa65-e715-4338-a736-19129971dc0e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:52.493134 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cb71fa65-e715-4338-a736-19129971dc0e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:52.621750 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cb71fa65-e715-4338-a736-19129971dc0e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:52.629491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cb71fa65-e715-4338-a736-19129971dc0e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.148802 Jul 28 09:13:52.630303 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 201/411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:52 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:52.891867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ccdfb048-c86c-40c4-99c6-aa9b3046388e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:52.892401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ccdfb048-c86c-40c4-99c6-aa9b3046388e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:52.898438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ccdfb048-c86c-40c4-99c6-aa9b3046388e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:52.898887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ccdfb048-c86c-40c4-99c6-aa9b3046388e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:52.899639 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ccdfb048-c86c-40c4-99c6-aa9b3046388e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:52.900072 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ccdfb048-c86c-40c4-99c6-aa9b3046388e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:52.903885 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:13:53.028342 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ccdfb048-c86c-40c4-99c6-aa9b3046388e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:53.035897 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ccdfb048-c86c-40c4-99c6-aa9b3046388e tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.147856 Jul 28 09:13:53.048785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 211/412] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:52 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:53.653212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9b6a3be9-1d56-4813-875e-40ee8f3edb39 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:53.653810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9b6a3be9-1d56-4813-875e-40ee8f3edb39 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:53.660367 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9b6a3be9-1d56-4813-875e-40ee8f3edb39 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:53.660840 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9b6a3be9-1d56-4813-875e-40ee8f3edb39 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:53.661595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9b6a3be9-1d56-4813-875e-40ee8f3edb39 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:53.662659 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9b6a3be9-1d56-4813-875e-40ee8f3edb39 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:53.791199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9b6a3be9-1d56-4813-875e-40ee8f3edb39 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:53.798712 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9b6a3be9-1d56-4813-875e-40ee8f3edb39 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.149524 Jul 28 09:13:53.799335 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 202/413] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:53 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:54.056593 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aa2293b0-034e-47d4-875d-c7ce1c0beb2b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:54.057199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-aa2293b0-034e-47d4-875d-c7ce1c0beb2b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:54.063147 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa2293b0-034e-47d4-875d-c7ce1c0beb2b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:54.063596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa2293b0-034e-47d4-875d-c7ce1c0beb2b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:54.064356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa2293b0-034e-47d4-875d-c7ce1c0beb2b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:54.064792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa2293b0-034e-47d4-875d-c7ce1c0beb2b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:54.195846 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-aa2293b0-034e-47d4-875d-c7ce1c0beb2b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:54.204021 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aa2293b0-034e-47d4-875d-c7ce1c0beb2b tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.151761 Jul 28 09:13:54.204582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 212/414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:54 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:54.820452 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d125ce47-79c3-4072-95a1-ea022526bf9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:54.821053 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d125ce47-79c3-4072-95a1-ea022526bf9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:54.827898 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d125ce47-79c3-4072-95a1-ea022526bf9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:54.828576 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d125ce47-79c3-4072-95a1-ea022526bf9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:54.829339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d125ce47-79c3-4072-95a1-ea022526bf9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:54.829774 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d125ce47-79c3-4072-95a1-ea022526bf9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:54.980326 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d125ce47-79c3-4072-95a1-ea022526bf9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:54.988686 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d125ce47-79c3-4072-95a1-ea022526bf9c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.172839 Jul 28 09:13:54.989514 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 203/415] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:54 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:55.011199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-f82754da-158e-4e2e-9498-9893800a1282 req-efb05543-4db9-46ca-a1d8-1df49dc7943b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3317255-2cf3-4607-b66e-4304074841bb", "name": "network-vif-plugged", "status": "completed", "tag": "c1c43e9c-6a89-49b1-876d-70dd41025c51"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:55.020989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f82754da-158e-4e2e-9498-9893800a1282 req-efb05543-4db9-46ca-a1d8-1df49dc7943b service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:55.022262 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f82754da-158e-4e2e-9498-9893800a1282 req-efb05543-4db9-46ca-a1d8-1df49dc7943b service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:55.035106 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-f82754da-158e-4e2e-9498-9893800a1282 req-efb05543-4db9-46ca-a1d8-1df49dc7943b service nova] Creating event network-vif-plugged:c1c43e9c-6a89-49b1-876d-70dd41025c51 for instance a3317255-2cf3-4607-b66e-4304074841bb on hv-cinder-85124 Jul 28 09:13:55.040184 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-f82754da-158e-4e2e-9498-9893800a1282 req-efb05543-4db9-46ca-a1d8-1df49dc7943b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 Jul 28 09:13:55.040782 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 213/416] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:13:55.224428 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-fbf0fcab-4e53-41c3-9e73-f09ff1a0abeb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:55.225035 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-fbf0fcab-4e53-41c3-9e73-f09ff1a0abeb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:55.230978 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fbf0fcab-4e53-41c3-9e73-f09ff1a0abeb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:55.231422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fbf0fcab-4e53-41c3-9e73-f09ff1a0abeb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:55.232776 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fbf0fcab-4e53-41c3-9e73-f09ff1a0abeb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:55.233214 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fbf0fcab-4e53-41c3-9e73-f09ff1a0abeb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:55.385634 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-fbf0fcab-4e53-41c3-9e73-f09ff1a0abeb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:55.393600 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-fbf0fcab-4e53-41c3-9e73-f09ff1a0abeb tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.172978 Jul 28 09:13:55.394328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 204/417] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:55 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:56.012824 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c360825f-0469-4c52-9f01-cdd020085667 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:56.013525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c360825f-0469-4c52-9f01-cdd020085667 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:56.019703 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c360825f-0469-4c52-9f01-cdd020085667 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:56.020162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c360825f-0469-4c52-9f01-cdd020085667 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:56.020951 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c360825f-0469-4c52-9f01-cdd020085667 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:56.021393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c360825f-0469-4c52-9f01-cdd020085667 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:56.155719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c360825f-0469-4c52-9f01-cdd020085667 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:56.163164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c360825f-0469-4c52-9f01-cdd020085667 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.154617 Jul 28 09:13:56.163930 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 214/418] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:56 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:56.417263 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a201fd03-f113-4a36-b4e1-c2b90faca7d2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:56.417900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a201fd03-f113-4a36-b4e1-c2b90faca7d2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:56.431395 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a201fd03-f113-4a36-b4e1-c2b90faca7d2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:56.432296 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a201fd03-f113-4a36-b4e1-c2b90faca7d2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:56.433729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a201fd03-f113-4a36-b4e1-c2b90faca7d2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:56.434981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a201fd03-f113-4a36-b4e1-c2b90faca7d2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:56.600381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a201fd03-f113-4a36-b4e1-c2b90faca7d2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:56.608543 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a201fd03-f113-4a36-b4e1-c2b90faca7d2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.196884 Jul 28 09:13:56.617906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 205/419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:56 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:57.184301 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f5830d38-05db-41a2-8db0-4b0cbcbc60db tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:57.184955 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f5830d38-05db-41a2-8db0-4b0cbcbc60db tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:57.192084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5830d38-05db-41a2-8db0-4b0cbcbc60db tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:57.192533 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5830d38-05db-41a2-8db0-4b0cbcbc60db tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:57.193822 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5830d38-05db-41a2-8db0-4b0cbcbc60db tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:57.194254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5830d38-05db-41a2-8db0-4b0cbcbc60db tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:57.329552 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f5830d38-05db-41a2-8db0-4b0cbcbc60db tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:57.342727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f5830d38-05db-41a2-8db0-4b0cbcbc60db tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.162256 Jul 28 09:13:57.343436 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 215/420] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:57 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:57.630573 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-463f01dd-d542-435d-aa36-097df752d04c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:57.631964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-463f01dd-d542-435d-aa36-097df752d04c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:57.639201 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-463f01dd-d542-435d-aa36-097df752d04c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:57.639786 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-463f01dd-d542-435d-aa36-097df752d04c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:57.640777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-463f01dd-d542-435d-aa36-097df752d04c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:57.641258 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-463f01dd-d542-435d-aa36-097df752d04c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:57.776999 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-463f01dd-d542-435d-aa36-097df752d04c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:57.796079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-463f01dd-d542-435d-aa36-097df752d04c tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.169201 Jul 28 09:13:57.796662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 206/421] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:57 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:58.365292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c862ee11-f794-44aa-9101-c84b6110a7a4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:58.366057 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c862ee11-f794-44aa-9101-c84b6110a7a4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:58.372253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c862ee11-f794-44aa-9101-c84b6110a7a4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:58.372708 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c862ee11-f794-44aa-9101-c84b6110a7a4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:58.375020 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c862ee11-f794-44aa-9101-c84b6110a7a4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:58.375566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c862ee11-f794-44aa-9101-c84b6110a7a4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:58.511604 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c862ee11-f794-44aa-9101-c84b6110a7a4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:58.520082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c862ee11-f794-44aa-9101-c84b6110a7a4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.159515 Jul 28 09:13:58.520644 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 216/422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:58 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:58.816890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-91089913-8285-459e-906c-825d98bec8be tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:58.817568 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-91089913-8285-459e-906c-825d98bec8be tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:58.825404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-91089913-8285-459e-906c-825d98bec8be tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:58.825910 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-91089913-8285-459e-906c-825d98bec8be tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:58.826670 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-91089913-8285-459e-906c-825d98bec8be tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:58.827540 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-91089913-8285-459e-906c-825d98bec8be tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:58.960262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-91089913-8285-459e-906c-825d98bec8be tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:58.967761 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-91089913-8285-459e-906c-825d98bec8be tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.154588 Jul 28 09:13:58.968333 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 207/423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:58 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:59.542646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c9f9cd1e-69be-4064-94e1-3956947819c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:59.543259 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c9f9cd1e-69be-4064-94e1-3956947819c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:59.553778 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c9f9cd1e-69be-4064-94e1-3956947819c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.554255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c9f9cd1e-69be-4064-94e1-3956947819c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.555031 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c9f9cd1e-69be-4064-94e1-3956947819c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.557755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c9f9cd1e-69be-4064-94e1-3956947819c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.693390 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c9f9cd1e-69be-4064-94e1-3956947819c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:13:59.700972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c9f9cd1e-69be-4064-94e1-3956947819c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1500 microversion: 2.1 time: 0.162127 Jul 28 09:13:59.701854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 217/424] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:59 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:13:59.721821 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b2bb315-8d3d-4df3-a4ee-e7883053cf33"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:59.724257 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:59.730830 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.731277 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.732032 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.732465 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.755491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] HTTP exception thrown: Cannot 'attach_volume' instance 25e208af-ae8f-482f-b140-66e820fb9f4c while it is in vm_state rescued Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Request method failure captured: Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: POST /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c/os-volume_attachments HTTP/1.1 Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 74 Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLAPGLX22q_Q72umgmxlgc_aqO594bbQCBzsIS-QcLuSvE8L3peXSJgCX3ZJfsFRvFXmpkeBL9AYxhV3YxULcppJgQE7K3YNuKQNhmzaeAPYyj2sHvKJe3wq4C7OwoS0ZyBeINcu4yhntqqK6I0lgT33c7MoghbwUrepU-74mtzo-c Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:13:59.757662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34cb634f5c154187a943a454a706f200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34cb634f5c154187a943a454a706f200", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}] Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: aff89a63c86f4e6f906988791f3c5258 Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {"volumeAttachment": {"volumeId": "4b2bb315-8d3d-4df3-a4ee-e7883053cf33"}} Jul 28 09:13:59.758964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Cannot 'attach_volume' instance 25e208af-ae8f-482f-b140-66e820fb9f4c while it is in vm_state rescued Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'server_id': '25e208af-ae8f-482f-b140-66e820fb9f4c', 'body': {'volumeAttachment': {'volumeId': '4b2bb315-8d3d-4df3-a4ee-e7883053cf33'}}} Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 25e208af-ae8f-482f-b140-66e820fb9f4c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:13:59.759688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 25e208af-ae8f-482f-b140-66e820fb9f4c while it is in vm_state rescued Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:13:59.761327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:13:59.762420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:13:59.762420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:13:59.762420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 25e208af-ae8f-482f-b140-66e820fb9f4c while it is in vm_state rescued Jul 28 09:13:59.762420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:13:59.762420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Returning 409 to user: Cannot 'attach_volume' instance 25e208af-ae8f-482f-b140-66e820fb9f4c while it is in vm_state rescued {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:13:59.762420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6e444db8-a566-4df3-9033-cddac7765c51 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041206 Jul 28 09:13:59.762420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 208/425] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:13:59 2022] POST /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 09:13:59.768415 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1084456d-64bc-45c2-8f6f-e5c49b1b113c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:13:59.768950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1084456d-64bc-45c2-8f6f-e5c49b1b113c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:59.775619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1084456d-64bc-45c2-8f6f-e5c49b1b113c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.776063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1084456d-64bc-45c2-8f6f-e5c49b1b113c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.777182 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1084456d-64bc-45c2-8f6f-e5c49b1b113c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.777317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1084456d-64bc-45c2-8f6f-e5c49b1b113c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.843148 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1084456d-64bc-45c2-8f6f-e5c49b1b113c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c/action" status: 202 len: 0 microversion: 2.1 time: 0.078245 Jul 28 09:13:59.844017 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 218/426] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:13:59 2022] POST /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:13:59.853078 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3148ced1-dcfb-463e-bb51-21b4dbaa9ea8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:59.853674 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3148ced1-dcfb-463e-bb51-21b4dbaa9ea8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:59.861215 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3148ced1-dcfb-463e-bb51-21b4dbaa9ea8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.861658 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3148ced1-dcfb-463e-bb51-21b4dbaa9ea8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.862444 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3148ced1-dcfb-463e-bb51-21b4dbaa9ea8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.863047 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3148ced1-dcfb-463e-bb51-21b4dbaa9ea8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.989179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-acd46ea9-4674-44e1-a8e8-91d9500e92b1 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:13:59.990727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-acd46ea9-4674-44e1-a8e8-91d9500e92b1 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:13:59.997175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-acd46ea9-4674-44e1-a8e8-91d9500e92b1 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.997699 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-acd46ea9-4674-44e1-a8e8-91d9500e92b1 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:13:59.998786 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-acd46ea9-4674-44e1-a8e8-91d9500e92b1 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:13:59.999131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-acd46ea9-4674-44e1-a8e8-91d9500e92b1 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:00.007359 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3148ced1-dcfb-463e-bb51-21b4dbaa9ea8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:00.015926 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3148ced1-dcfb-463e-bb51-21b4dbaa9ea8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1508 microversion: 2.1 time: 0.167622 Jul 28 09:14:00.016676 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 209/427] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:59 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:00.131874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-acd46ea9-4674-44e1-a8e8-91d9500e92b1 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:00.139564 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-acd46ea9-4674-44e1-a8e8-91d9500e92b1 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1313 microversion: 2.1 time: 0.154988 Jul 28 09:14:00.140135 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 219/428] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:13:59 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:01.037776 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-37925bd1-7942-4d50-86f9-941719357318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:01.038876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-37925bd1-7942-4d50-86f9-941719357318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:01.047327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37925bd1-7942-4d50-86f9-941719357318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:01.047907 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37925bd1-7942-4d50-86f9-941719357318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:01.049239 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37925bd1-7942-4d50-86f9-941719357318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:01.049782 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37925bd1-7942-4d50-86f9-941719357318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:01.161996 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9968243b-1f5b-4315-95d2-585b90766d8d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:01.162608 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9968243b-1f5b-4315-95d2-585b90766d8d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:01.169996 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9968243b-1f5b-4315-95d2-585b90766d8d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:01.170448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9968243b-1f5b-4315-95d2-585b90766d8d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:01.171280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9968243b-1f5b-4315-95d2-585b90766d8d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:01.171887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9968243b-1f5b-4315-95d2-585b90766d8d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:01.326032 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-37925bd1-7942-4d50-86f9-941719357318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:01.328595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:01.337157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-37925bd1-7942-4d50-86f9-941719357318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1508 microversion: 2.1 time: 0.304171 Jul 28 09:14:01.337635 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 210/429] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:01 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:01.430272 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9968243b-1f5b-4315-95d2-585b90766d8d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:01.439101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9968243b-1f5b-4315-95d2-585b90766d8d tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1496 microversion: 2.1 time: 0.282198 Jul 28 09:14:01.439793 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 220/430] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:01 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1496 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:14:02.177914 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-80aca66f-c043-42d9-86da-518cf5a7d9a0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:02.178428 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-80aca66f-c043-42d9-86da-518cf5a7d9a0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:02.184727 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-80aca66f-c043-42d9-86da-518cf5a7d9a0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:02.185184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-80aca66f-c043-42d9-86da-518cf5a7d9a0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:02.185965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-80aca66f-c043-42d9-86da-518cf5a7d9a0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:02.186405 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-80aca66f-c043-42d9-86da-518cf5a7d9a0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:02.212408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-80aca66f-c043-42d9-86da-518cf5a7d9a0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:14:02.292218 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-80aca66f-c043-42d9-86da-518cf5a7d9a0 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 204 len: 0 microversion: 2.1 time: 0.118185 Jul 28 09:14:02.292955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 211/431] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:14:02 2022] DELETE /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:14:02.302062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a438136d-c119-44b3-a6e6-f9959174f1cf tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:02.303528 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a438136d-c119-44b3-a6e6-f9959174f1cf tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:02.309945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a438136d-c119-44b3-a6e6-f9959174f1cf tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:02.310550 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a438136d-c119-44b3-a6e6-f9959174f1cf tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:02.311456 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a438136d-c119-44b3-a6e6-f9959174f1cf tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:02.311900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a438136d-c119-44b3-a6e6-f9959174f1cf tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:02.323666 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ceac76c6-2e6b-4e18-9de1-8d8dab1721e3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c514e0b5-51a3-4ad5-8fda-8003b8d69929", "device": "/dev/sdb"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:14:02.327996 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ceac76c6-2e6b-4e18-9de1-8d8dab1721e3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:02.335056 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ceac76c6-2e6b-4e18-9de1-8d8dab1721e3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:02.335469 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ceac76c6-2e6b-4e18-9de1-8d8dab1721e3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:02.336233 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ceac76c6-2e6b-4e18-9de1-8d8dab1721e3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:02.336664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ceac76c6-2e6b-4e18-9de1-8d8dab1721e3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:02.447033 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a438136d-c119-44b3-a6e6-f9959174f1cf tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:02.454840 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a438136d-c119-44b3-a6e6-f9959174f1cf tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1502 microversion: 2.1 time: 0.157694 Jul 28 09:14:02.455488 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 221/432] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:02 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:02.460852 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-26bd4651-eeb1-46f0-af0d-2690354bf526 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:02.461577 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-26bd4651-eeb1-46f0-af0d-2690354bf526 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:02.467599 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26bd4651-eeb1-46f0-af0d-2690354bf526 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:02.468170 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26bd4651-eeb1-46f0-af0d-2690354bf526 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:02.469037 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26bd4651-eeb1-46f0-af0d-2690354bf526 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:02.469580 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26bd4651-eeb1-46f0-af0d-2690354bf526 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:02.607715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-26bd4651-eeb1-46f0-af0d-2690354bf526 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:02.616131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-26bd4651-eeb1-46f0-af0d-2690354bf526 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1508 microversion: 2.1 time: 0.159559 Jul 28 09:14:02.616693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 222/433] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:02 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:03.477438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cc4ba86d-2848-48f8-8e42-9b9ba2317265 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:03.478168 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cc4ba86d-2848-48f8-8e42-9b9ba2317265 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:03.484335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cc4ba86d-2848-48f8-8e42-9b9ba2317265 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:03.484783 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cc4ba86d-2848-48f8-8e42-9b9ba2317265 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:03.485555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cc4ba86d-2848-48f8-8e42-9b9ba2317265 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:03.486024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cc4ba86d-2848-48f8-8e42-9b9ba2317265 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:03.618087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cc4ba86d-2848-48f8-8e42-9b9ba2317265 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:03.625726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cc4ba86d-2848-48f8-8e42-9b9ba2317265 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1502 microversion: 2.1 time: 0.152992 Jul 28 09:14:03.626308 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 223/434] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:03 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:14:03.637204 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bcc399bf-6301-4677-b00d-2339a6dfef4d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:03.638035 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bcc399bf-6301-4677-b00d-2339a6dfef4d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:03.645385 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bcc399bf-6301-4677-b00d-2339a6dfef4d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:03.645864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bcc399bf-6301-4677-b00d-2339a6dfef4d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:03.646788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bcc399bf-6301-4677-b00d-2339a6dfef4d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:03.647229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bcc399bf-6301-4677-b00d-2339a6dfef4d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:03.780017 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-bcc399bf-6301-4677-b00d-2339a6dfef4d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:03.787950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bcc399bf-6301-4677-b00d-2339a6dfef4d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1508 microversion: 2.1 time: 0.154821 Jul 28 09:14:03.788510 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 224/435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:03 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:14:04.648847 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-50b01f2d-c3e2-42f6-b02c-c7ae0fc0d0b7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:04.649494 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-50b01f2d-c3e2-42f6-b02c-c7ae0fc0d0b7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:04.655415 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50b01f2d-c3e2-42f6-b02c-c7ae0fc0d0b7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:04.655853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50b01f2d-c3e2-42f6-b02c-c7ae0fc0d0b7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:04.656599 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50b01f2d-c3e2-42f6-b02c-c7ae0fc0d0b7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:04.657026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50b01f2d-c3e2-42f6-b02c-c7ae0fc0d0b7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:04.789055 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-50b01f2d-c3e2-42f6-b02c-c7ae0fc0d0b7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:04.797471 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-50b01f2d-c3e2-42f6-b02c-c7ae0fc0d0b7 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1502 microversion: 2.1 time: 0.153069 Jul 28 09:14:04.798093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 225/436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:04 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:04.809684 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0b34822f-ea0a-40f0-94a5-58797cf9c046 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:04.810386 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0b34822f-ea0a-40f0-94a5-58797cf9c046 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:04.816428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b34822f-ea0a-40f0-94a5-58797cf9c046 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:04.816873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b34822f-ea0a-40f0-94a5-58797cf9c046 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:04.817657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b34822f-ea0a-40f0-94a5-58797cf9c046 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:04.818118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b34822f-ea0a-40f0-94a5-58797cf9c046 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:04.948493 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b34822f-ea0a-40f0-94a5-58797cf9c046 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:04.956218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0b34822f-ea0a-40f0-94a5-58797cf9c046 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1508 microversion: 2.1 time: 0.150187 Jul 28 09:14:04.956774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 226/437] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:04 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:14:05.820039 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-762ccdf9-3c74-4242-92f3-e07125cbeaf3 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:05.820627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-762ccdf9-3c74-4242-92f3-e07125cbeaf3 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:05.827781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-762ccdf9-3c74-4242-92f3-e07125cbeaf3 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:05.828301 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-762ccdf9-3c74-4242-92f3-e07125cbeaf3 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:05.829059 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-762ccdf9-3c74-4242-92f3-e07125cbeaf3 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:05.829490 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-762ccdf9-3c74-4242-92f3-e07125cbeaf3 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:05.859978 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:05.982294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-762ccdf9-3c74-4242-92f3-e07125cbeaf3 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:05.989651 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-762ccdf9-3c74-4242-92f3-e07125cbeaf3 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1502 microversion: 2.1 time: 0.174244 Jul 28 09:14:05.990438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 227/438] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:05 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:14:05.994772 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f7c853e0-5fe8-49a8-83db-7b694ec55730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:05.995379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f7c853e0-5fe8-49a8-83db-7b694ec55730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:06.001759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f7c853e0-5fe8-49a8-83db-7b694ec55730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:06.002269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f7c853e0-5fe8-49a8-83db-7b694ec55730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:06.003059 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f7c853e0-5fe8-49a8-83db-7b694ec55730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:06.003505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f7c853e0-5fe8-49a8-83db-7b694ec55730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:06.134660 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f7c853e0-5fe8-49a8-83db-7b694ec55730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:06.142151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f7c853e0-5fe8-49a8-83db-7b694ec55730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1514 microversion: 2.1 time: 0.150806 Jul 28 09:14:06.142719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 228/439] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:05 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:06.444970 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ceac76c6-2e6b-4e18-9de1-8d8dab1721e3 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "POST /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.126880 Jul 28 09:14:06.445577 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 212/440] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:14:02 2022] POST /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385/os-volume_attachments => generated 194 bytes in 4128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:14:07.010690 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d059c1ce-fc6e-4d30-8796-de733789d1a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:07.011408 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d059c1ce-fc6e-4d30-8796-de733789d1a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:07.017281 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d059c1ce-fc6e-4d30-8796-de733789d1a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:07.017733 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d059c1ce-fc6e-4d30-8796-de733789d1a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:07.018539 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d059c1ce-fc6e-4d30-8796-de733789d1a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:07.018976 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d059c1ce-fc6e-4d30-8796-de733789d1a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:07.207582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d059c1ce-fc6e-4d30-8796-de733789d1a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c077c212f1472d85df56c05a51ceb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707034727c6c44eb8cea2f5951ac48b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:07.216354 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d059c1ce-fc6e-4d30-8796-de733789d1a2 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 200 len: 1502 microversion: 2.1 time: 0.209349 Jul 28 09:14:07.216941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 229/441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:07 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 1502 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:07.348238 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-a2cbbee9-befe-41d7-ab63-096456ed9997 req-35c7a9a9-f3eb-42ad-9c9d-b4f35a711835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3317255-2cf3-4607-b66e-4304074841bb", "name": "network-vif-deleted", "tag": "c1c43e9c-6a89-49b1-876d-70dd41025c51"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:14:07.357754 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:07.362699 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-a2cbbee9-befe-41d7-ab63-096456ed9997 req-35c7a9a9-f3eb-42ad-9c9d-b4f35a711835 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:07.363134 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-a2cbbee9-befe-41d7-ab63-096456ed9997 req-35c7a9a9-f3eb-42ad-9c9d-b4f35a711835 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:07.376256 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-a2cbbee9-befe-41d7-ab63-096456ed9997 req-35c7a9a9-f3eb-42ad-9c9d-b4f35a711835 service nova] Creating event network-vif-deleted:c1c43e9c-6a89-49b1-876d-70dd41025c51 for instance a3317255-2cf3-4607-b66e-4304074841bb on hv-cinder-85124 Jul 28 09:14:07.382903 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-a2cbbee9-befe-41d7-ab63-096456ed9997 req-35c7a9a9-f3eb-42ad-9c9d-b4f35a711835 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039382 Jul 28 09:14:07.383501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 213/442] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:14:07.502952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-956cc940-fc03-42df-a86e-e029736d7947 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'create', calling method: .version_select at 0x7fd6c538aee0>, body: {"keypair": {"name": "tempest-keypair-2021030049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER0/jEz6B0geyO0w3ARTUXw41OAaLUhwxOnJMVanRGNL6KWxbVkHIJOBupGqVC3zNt/8UqbjmHc9DrGFd7J7PsWW4x+pG8LkKAMGKmjOAFYLjUWmg3HwrJH2XDPiFRZGA=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:14:07.519222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-956cc940-fc03-42df-a86e-e029736d7947 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Getting quotas for project 34cb634f5c154187a943a454a706f200. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:14:07.524954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-956cc940-fc03-42df-a86e-e029736d7947 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Getting quotas for user aff89a63c86f4e6f906988791f3c5258 and project 34cb634f5c154187a943a454a706f200. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:14:07.548524 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-956cc940-fc03-42df-a86e-e029736d7947 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049392 Jul 28 09:14:07.549152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 230/443] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:14:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:14:08.239616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:08.240439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] [instance: a3317255-2cf3-4607-b66e-4304074841bb] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:08.247393 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:08.247845 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:08.248617 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:08.249050 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:08.263156 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] HTTP exception thrown: Instance a3317255-2cf3-4607-b66e-4304074841bb could not be found. Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Request method failure captured: Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb HTTP/1.1 Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lMTEZd8M5Fw1D1W5EN4SkbJnieEnn82E_6JR8v9P34SXKs1-CxEaOJ6O3BEJpOXeh_90xqiuaQ4RY1rz03I21IdhqbCkx-5GlQIJnANeMi_Vi8fw73gFyQWry8S3OY2gr15B1UzTrhOegXtoBORkUVQDodhEuFSZgrCYH9RMbzbw-A Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 707034727c6c44eb8cea2f5951ac48b7 Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesActionsTest-1472417548 Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:14:08.264808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/707034727c6c44eb8cea2f5951ac48b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/707034727c6c44eb8cea2f5951ac48b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_707034727c6c44eb8cea2f5951ac48b7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/707034727c6c44eb8cea2f5951ac48b7"}]}] Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesActionsTest-1472417548 Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 707034727c6c44eb8cea2f5951ac48b7 Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesActionsTest-1472417548 Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesActionsTest-1472417548-project Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 99c077c212f1472d85df56c05a51ceb9 Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesActionsTest-1472417548-project Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance a3317255-2cf3-4607-b66e-4304074841bb could not be found. Jul 28 09:14:08.266432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'a3317255-2cf3-4607-b66e-4304074841bb'} Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3317255-2cf3-4607-b66e-4304074841bb could not be found. Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:14:08.270507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3317255-2cf3-4607-b66e-4304074841bb could not be found. Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3317255-2cf3-4607-b66e-4304074841bb could not be found. Jul 28 09:14:08.272472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:08.273678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] Returning 404 to user: Instance a3317255-2cf3-4607-b66e-4304074841bb could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:14:08.273678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-fab1f741-584d-4dc9-b6fa-3d68cf7e9e11 tempest-VolumesActionsTest-1472417548 tempest-VolumesActionsTest-1472417548-project] 10.222.0.48 "GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb" status: 404 len: 111 microversion: 2.1 time: 0.031239 Jul 28 09:14:08.273678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 214/444] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:08 2022] GET /compute/v2.1/servers/a3317255-2cf3-4607-b66e-4304074841bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:14:09.163932 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-920687964", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64888555-aa9a-41f3-b5b6-dab010021048"}], "security_groups": [{"name": "tempest-securitygroup--1949052786"}], "key_name": "tempest-keypair-2021030049", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:14:09.267682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] validate_networks() for [('64888555-aa9a-41f3-b5b6-dab010021048', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:14:09.645370 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:14:09.645793 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:14:09.646298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:14:09.647513 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:14:09.647682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:14:09.659576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:09.660026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:09.660827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:09.661268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:09.678735 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Getting quotas for project 34cb634f5c154187a943a454a706f200. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:14:09.682699 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Getting quotas for user aff89a63c86f4e6f906988791f3c5258 and project 34cb634f5c154187a943a454a706f200. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:14:09.694402 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:14:09.696675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:14:09.742918 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f9d5e8eb-fb96-4830-9d1c-71d837c7a43f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.583917 Jul 28 09:14:09.743693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 231/445] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:14:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:14:09.754620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-78065871-226c-4e7c-877c-197938cce318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:09.755229 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-78065871-226c-4e7c-877c-197938cce318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:09.812972 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-78065871-226c-4e7c-877c-197938cce318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:09.820294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-78065871-226c-4e7c-877c-197938cce318 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1245 microversion: 2.1 time: 0.069570 Jul 28 09:14:09.820964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 215/446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:09 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:10.842560 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1379e421-9f0d-4226-8696-0d01a18487f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:10.843172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1379e421-9f0d-4226-8696-0d01a18487f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:10.849861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1379e421-9f0d-4226-8696-0d01a18487f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:10.850319 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1379e421-9f0d-4226-8696-0d01a18487f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:10.851083 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1379e421-9f0d-4226-8696-0d01a18487f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:10.851520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1379e421-9f0d-4226-8696-0d01a18487f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:10.910292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1379e421-9f0d-4226-8696-0d01a18487f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:10.917894 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1379e421-9f0d-4226-8696-0d01a18487f0 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1249 microversion: 2.1 time: 0.079284 Jul 28 09:14:10.918461 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 232/447] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:10 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:11.938180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-413fa026-c02b-4c4b-b64d-fa3de43b8765 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:11.938790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-413fa026-c02b-4c4b-b64d-fa3de43b8765 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:11.946526 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-413fa026-c02b-4c4b-b64d-fa3de43b8765 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:11.946971 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-413fa026-c02b-4c4b-b64d-fa3de43b8765 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:11.947733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-413fa026-c02b-4c4b-b64d-fa3de43b8765 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:11.948165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-413fa026-c02b-4c4b-b64d-fa3de43b8765 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:12.017176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-413fa026-c02b-4c4b-b64d-fa3de43b8765 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:12.024888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-413fa026-c02b-4c4b-b64d-fa3de43b8765 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1249 microversion: 2.1 time: 0.090520 Jul 28 09:14:12.025440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 216/448] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:11 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:13.044548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e54e199e-ffb2-419e-8ff1-1d9064226360 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:13.045149 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e54e199e-ffb2-419e-8ff1-1d9064226360 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:13.051114 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e54e199e-ffb2-419e-8ff1-1d9064226360 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:13.051553 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e54e199e-ffb2-419e-8ff1-1d9064226360 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:13.052340 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e54e199e-ffb2-419e-8ff1-1d9064226360 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:13.052773 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e54e199e-ffb2-419e-8ff1-1d9064226360 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:13.112957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e54e199e-ffb2-419e-8ff1-1d9064226360 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:13.120926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e54e199e-ffb2-419e-8ff1-1d9064226360 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1249 microversion: 2.1 time: 0.080045 Jul 28 09:14:13.121470 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 233/449] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:13 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:14.141109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4b20ae00-1770-4481-9020-8789b0e46115 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:14.141724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4b20ae00-1770-4481-9020-8789b0e46115 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:14.149112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4b20ae00-1770-4481-9020-8789b0e46115 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:14.149561 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4b20ae00-1770-4481-9020-8789b0e46115 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:14.150355 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4b20ae00-1770-4481-9020-8789b0e46115 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:14.150797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4b20ae00-1770-4481-9020-8789b0e46115 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:14.211993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4b20ae00-1770-4481-9020-8789b0e46115 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:14.219702 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4b20ae00-1770-4481-9020-8789b0e46115 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1249 microversion: 2.1 time: 0.082321 Jul 28 09:14:14.220157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 217/450] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:14 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:15.240129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d58357b5-6efb-4679-8830-9d4f83417461 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:15.241941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d58357b5-6efb-4679-8830-9d4f83417461 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:15.243100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:15.248407 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d58357b5-6efb-4679-8830-9d4f83417461 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:15.248851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d58357b5-6efb-4679-8830-9d4f83417461 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:15.249615 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d58357b5-6efb-4679-8830-9d4f83417461 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:15.250070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d58357b5-6efb-4679-8830-9d4f83417461 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:15.312472 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d58357b5-6efb-4679-8830-9d4f83417461 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:15.320481 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d58357b5-6efb-4679-8830-9d4f83417461 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1249 microversion: 2.1 time: 0.084243 Jul 28 09:14:15.321031 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 234/451] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:15 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:16.342639 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ef0ff4c8-7219-4172-933c-fc1370356ac8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:16.343234 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ef0ff4c8-7219-4172-933c-fc1370356ac8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:16.349932 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef0ff4c8-7219-4172-933c-fc1370356ac8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:16.350371 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef0ff4c8-7219-4172-933c-fc1370356ac8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:16.351122 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef0ff4c8-7219-4172-933c-fc1370356ac8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:16.351853 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef0ff4c8-7219-4172-933c-fc1370356ac8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:16.422642 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ef0ff4c8-7219-4172-933c-fc1370356ac8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:16.430210 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ef0ff4c8-7219-4172-933c-fc1370356ac8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1249 microversion: 2.1 time: 0.092659 Jul 28 09:14:16.430784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 218/452] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:16 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:17.451293 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ef4e3d87-89a1-47ab-9b55-856111fbf069 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:17.451930 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ef4e3d87-89a1-47ab-9b55-856111fbf069 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:17.458228 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ef4e3d87-89a1-47ab-9b55-856111fbf069 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:17.458678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ef4e3d87-89a1-47ab-9b55-856111fbf069 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:17.459435 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ef4e3d87-89a1-47ab-9b55-856111fbf069 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:17.459871 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ef4e3d87-89a1-47ab-9b55-856111fbf069 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:17.519389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ef4e3d87-89a1-47ab-9b55-856111fbf069 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:17.527725 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ef4e3d87-89a1-47ab-9b55-856111fbf069 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1249 microversion: 2.1 time: 0.080341 Jul 28 09:14:17.528294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 235/453] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:17 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:18.548712 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-59051056-bb32-4ff9-912f-2650463894ae tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:18.549362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-59051056-bb32-4ff9-912f-2650463894ae tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:18.556834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-59051056-bb32-4ff9-912f-2650463894ae tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:18.557287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-59051056-bb32-4ff9-912f-2650463894ae tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:18.558092 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-59051056-bb32-4ff9-912f-2650463894ae tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:18.558530 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-59051056-bb32-4ff9-912f-2650463894ae tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:18.618433 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-59051056-bb32-4ff9-912f-2650463894ae tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:18.625881 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-59051056-bb32-4ff9-912f-2650463894ae tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1241 microversion: 2.1 time: 0.080970 Jul 28 09:14:18.626435 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 219/454] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:18 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:19.647983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a84a4c87-5f95-4b6f-b322-a5b5da0f8157 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:19.648668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a84a4c87-5f95-4b6f-b322-a5b5da0f8157 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:19.655520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a84a4c87-5f95-4b6f-b322-a5b5da0f8157 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:19.655967 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a84a4c87-5f95-4b6f-b322-a5b5da0f8157 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:19.656730 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a84a4c87-5f95-4b6f-b322-a5b5da0f8157 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:19.657160 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a84a4c87-5f95-4b6f-b322-a5b5da0f8157 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:19.673169 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:19.689935 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=10 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:19.721183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a84a4c87-5f95-4b6f-b322-a5b5da0f8157 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:19.731984 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a84a4c87-5f95-4b6f-b322-a5b5da0f8157 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1297 microversion: 2.1 time: 0.087710 Jul 28 09:14:19.732964 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 236/455] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:19 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:20.754398 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a279c489-296d-4420-84c1-81a819019853 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:20.755054 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a279c489-296d-4420-84c1-81a819019853 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:20.757409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:20.762777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a279c489-296d-4420-84c1-81a819019853 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:20.763224 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a279c489-296d-4420-84c1-81a819019853 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:20.763987 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a279c489-296d-4420-84c1-81a819019853 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:20.764425 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a279c489-296d-4420-84c1-81a819019853 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:20.840876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a279c489-296d-4420-84c1-81a819019853 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:20.848429 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a279c489-296d-4420-84c1-81a819019853 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1303 microversion: 2.1 time: 0.097878 Jul 28 09:14:20.849584 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 220/456] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:20 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:21.873064 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b44853d5-134f-40e4-8cbb-68ea78f8f860 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:21.873745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b44853d5-134f-40e4-8cbb-68ea78f8f860 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:21.883492 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b44853d5-134f-40e4-8cbb-68ea78f8f860 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:21.886237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b44853d5-134f-40e4-8cbb-68ea78f8f860 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:21.889778 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b44853d5-134f-40e4-8cbb-68ea78f8f860 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:21.890529 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b44853d5-134f-40e4-8cbb-68ea78f8f860 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:22.170989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b44853d5-134f-40e4-8cbb-68ea78f8f860 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:22.183409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b44853d5-134f-40e4-8cbb-68ea78f8f860 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.314701 Jul 28 09:14:22.183991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 237/457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:21 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:22.293953 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-8ad90fc1-2278-4e9f-83ac-2d0babd212b3 req-1b3fb237-4446-4c08-973d-4a4fbb912dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f77207-4c9e-4c6b-8948-d42f1f28c4aa", "tag": "433c3376-c310-4c2a-80fa-815d10d185aa"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:14:22.310909 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-8ad90fc1-2278-4e9f-83ac-2d0babd212b3 req-1b3fb237-4446-4c08-973d-4a4fbb912dc6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:22.311784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-8ad90fc1-2278-4e9f-83ac-2d0babd212b3 req-1b3fb237-4446-4c08-973d-4a4fbb912dc6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:22.329528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-8ad90fc1-2278-4e9f-83ac-2d0babd212b3 req-1b3fb237-4446-4c08-973d-4a4fbb912dc6 service nova] Creating event network-changed:433c3376-c310-4c2a-80fa-815d10d185aa for instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa on hv-cinder-85124 Jul 28 09:14:22.336775 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-8ad90fc1-2278-4e9f-83ac-2d0babd212b3 req-1b3fb237-4446-4c08-973d-4a4fbb912dc6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047372 Jul 28 09:14:22.341446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 221/458] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:14:23.204814 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a88d84aa-f314-4328-a125-830526c52a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:23.205451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a88d84aa-f314-4328-a125-830526c52a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:23.212359 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a88d84aa-f314-4328-a125-830526c52a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:23.213077 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a88d84aa-f314-4328-a125-830526c52a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:23.213950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a88d84aa-f314-4328-a125-830526c52a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:23.214395 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a88d84aa-f314-4328-a125-830526c52a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:23.352828 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a88d84aa-f314-4328-a125-830526c52a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:23.361289 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a88d84aa-f314-4328-a125-830526c52a95 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.160331 Jul 28 09:14:23.361900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 238/459] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:23 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:24.383507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2e10ab23-882c-4360-ab4a-35175846fe64 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:24.384432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2e10ab23-882c-4360-ab4a-35175846fe64 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:24.391749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2e10ab23-882c-4360-ab4a-35175846fe64 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:24.392475 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2e10ab23-882c-4360-ab4a-35175846fe64 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:24.393492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2e10ab23-882c-4360-ab4a-35175846fe64 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:24.394236 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2e10ab23-882c-4360-ab4a-35175846fe64 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:24.557106 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2e10ab23-882c-4360-ab4a-35175846fe64 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:24.565889 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2e10ab23-882c-4360-ab4a-35175846fe64 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.187060 Jul 28 09:14:24.566464 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 222/460] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:24 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:14:25.588206 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d4d27544-beb7-42bb-87f5-5ea2b95d8217 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:25.589082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d4d27544-beb7-42bb-87f5-5ea2b95d8217 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:25.598158 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d4d27544-beb7-42bb-87f5-5ea2b95d8217 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:25.599644 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d4d27544-beb7-42bb-87f5-5ea2b95d8217 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:25.602255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d4d27544-beb7-42bb-87f5-5ea2b95d8217 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:25.603206 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d4d27544-beb7-42bb-87f5-5ea2b95d8217 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:25.750845 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d4d27544-beb7-42bb-87f5-5ea2b95d8217 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:25.759085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d4d27544-beb7-42bb-87f5-5ea2b95d8217 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.175249 Jul 28 09:14:25.759763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 239/461] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:25 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:26.780815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cef2c405-e2a6-4930-8ca4-483d4f4cd957 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:26.781421 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cef2c405-e2a6-4930-8ca4-483d4f4cd957 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:26.787810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cef2c405-e2a6-4930-8ca4-483d4f4cd957 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:26.788255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cef2c405-e2a6-4930-8ca4-483d4f4cd957 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:26.789007 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cef2c405-e2a6-4930-8ca4-483d4f4cd957 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:26.790116 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cef2c405-e2a6-4930-8ca4-483d4f4cd957 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:26.926079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cef2c405-e2a6-4930-8ca4-483d4f4cd957 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:26.933586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cef2c405-e2a6-4930-8ca4-483d4f4cd957 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.156701 Jul 28 09:14:26.934179 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 223/462] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:26 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:27.954756 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ba836309-da64-48f0-8c18-9ca15c33b90f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:27.955365 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ba836309-da64-48f0-8c18-9ca15c33b90f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:27.961888 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ba836309-da64-48f0-8c18-9ca15c33b90f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:27.962343 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ba836309-da64-48f0-8c18-9ca15c33b90f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:27.963255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ba836309-da64-48f0-8c18-9ca15c33b90f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:27.963690 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ba836309-da64-48f0-8c18-9ca15c33b90f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:28.091296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ba836309-da64-48f0-8c18-9ca15c33b90f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:28.098546 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ba836309-da64-48f0-8c18-9ca15c33b90f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.147593 Jul 28 09:14:28.099105 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 240/463] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:27 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:29.126608 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1d80aacb-2835-4885-9556-fe4ec2711284 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:29.131634 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1d80aacb-2835-4885-9556-fe4ec2711284 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:29.159411 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d80aacb-2835-4885-9556-fe4ec2711284 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:29.159856 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d80aacb-2835-4885-9556-fe4ec2711284 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:29.161433 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d80aacb-2835-4885-9556-fe4ec2711284 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:29.162306 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d80aacb-2835-4885-9556-fe4ec2711284 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:29.563721 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1d80aacb-2835-4885-9556-fe4ec2711284 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:29.581585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1d80aacb-2835-4885-9556-fe4ec2711284 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.462053 Jul 28 09:14:29.582595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 224/464] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:29 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:30.602609 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-78a88076-b1bf-41bb-a916-aafd6042a6f8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:30.603715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-78a88076-b1bf-41bb-a916-aafd6042a6f8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:30.610076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-78a88076-b1bf-41bb-a916-aafd6042a6f8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:30.610825 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-78a88076-b1bf-41bb-a916-aafd6042a6f8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:30.611602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-78a88076-b1bf-41bb-a916-aafd6042a6f8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:30.612035 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-78a88076-b1bf-41bb-a916-aafd6042a6f8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:30.767118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-78a88076-b1bf-41bb-a916-aafd6042a6f8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:30.774541 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-78a88076-b1bf-41bb-a916-aafd6042a6f8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.176510 Jul 28 09:14:30.775069 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 241/465] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:30 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:31.795734 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0d2bd692-b351-4917-87a3-888c8fe70cb2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:31.796570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0d2bd692-b351-4917-87a3-888c8fe70cb2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:31.803960 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0d2bd692-b351-4917-87a3-888c8fe70cb2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:31.804504 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0d2bd692-b351-4917-87a3-888c8fe70cb2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:31.805686 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0d2bd692-b351-4917-87a3-888c8fe70cb2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:31.806228 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0d2bd692-b351-4917-87a3-888c8fe70cb2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:31.987141 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0d2bd692-b351-4917-87a3-888c8fe70cb2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:31.995427 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0d2bd692-b351-4917-87a3-888c8fe70cb2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.203402 Jul 28 09:14:32.002470 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 225/466] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:31 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:33.021997 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b398e4cf-b7b5-49e6-9f1c-ef873db9130f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:33.022601 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b398e4cf-b7b5-49e6-9f1c-ef873db9130f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:33.032882 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b398e4cf-b7b5-49e6-9f1c-ef873db9130f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:33.034605 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b398e4cf-b7b5-49e6-9f1c-ef873db9130f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:33.035616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b398e4cf-b7b5-49e6-9f1c-ef873db9130f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:33.036265 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b398e4cf-b7b5-49e6-9f1c-ef873db9130f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:33.186969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b398e4cf-b7b5-49e6-9f1c-ef873db9130f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:33.205263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b398e4cf-b7b5-49e6-9f1c-ef873db9130f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.188005 Jul 28 09:14:33.206094 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 242/467] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:33 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:34.227882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-54b6657a-0775-4c9b-834f-4d1992111964 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:34.228476 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-54b6657a-0775-4c9b-834f-4d1992111964 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:34.241217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-54b6657a-0775-4c9b-834f-4d1992111964 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:34.241666 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-54b6657a-0775-4c9b-834f-4d1992111964 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:34.243029 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-54b6657a-0775-4c9b-834f-4d1992111964 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:34.243463 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-54b6657a-0775-4c9b-834f-4d1992111964 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:34.253942 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:34.445292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-54b6657a-0775-4c9b-834f-4d1992111964 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:34.454721 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-54b6657a-0775-4c9b-834f-4d1992111964 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.230687 Jul 28 09:14:34.455679 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 226/468] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:34 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:35.476485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fad05e10-c7b3-47e1-868b-239f81bfc06e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:35.477925 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fad05e10-c7b3-47e1-868b-239f81bfc06e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:35.484454 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fad05e10-c7b3-47e1-868b-239f81bfc06e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:35.485237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fad05e10-c7b3-47e1-868b-239f81bfc06e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:35.486112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fad05e10-c7b3-47e1-868b-239f81bfc06e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:35.486783 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fad05e10-c7b3-47e1-868b-239f81bfc06e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:35.643060 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fad05e10-c7b3-47e1-868b-239f81bfc06e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:35.652997 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fad05e10-c7b3-47e1-868b-239f81bfc06e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.180183 Jul 28 09:14:35.653514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 243/469] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:35 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:36.675087 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-123add0f-3b5b-451b-979f-b34dcdcea88a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:36.675683 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-123add0f-3b5b-451b-979f-b34dcdcea88a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:36.683592 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-123add0f-3b5b-451b-979f-b34dcdcea88a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:36.684038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-123add0f-3b5b-451b-979f-b34dcdcea88a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:36.684815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-123add0f-3b5b-451b-979f-b34dcdcea88a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:36.685249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-123add0f-3b5b-451b-979f-b34dcdcea88a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:36.822388 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-123add0f-3b5b-451b-979f-b34dcdcea88a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:36.830271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-123add0f-3b5b-451b-979f-b34dcdcea88a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.159233 Jul 28 09:14:36.830825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 227/470] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:36 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:37.851616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2cb52da3-664e-4e78-b654-26eaeb6470bf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:37.852300 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2cb52da3-664e-4e78-b654-26eaeb6470bf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:37.868161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2cb52da3-664e-4e78-b654-26eaeb6470bf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:37.868706 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2cb52da3-664e-4e78-b654-26eaeb6470bf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:37.869643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2cb52da3-664e-4e78-b654-26eaeb6470bf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:37.870098 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2cb52da3-664e-4e78-b654-26eaeb6470bf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:37.874276 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=89 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:38.005428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2cb52da3-664e-4e78-b654-26eaeb6470bf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:38.014294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2cb52da3-664e-4e78-b654-26eaeb6470bf tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.166431 Jul 28 09:14:38.017876 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 244/471] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:37 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:39.034855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-71fbeff5-9368-4768-90a2-4e28b48b1730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:39.035464 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-71fbeff5-9368-4768-90a2-4e28b48b1730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:39.037711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=32 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:39.043436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-71fbeff5-9368-4768-90a2-4e28b48b1730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:39.043885 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-71fbeff5-9368-4768-90a2-4e28b48b1730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:39.044645 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-71fbeff5-9368-4768-90a2-4e28b48b1730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:39.045090 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-71fbeff5-9368-4768-90a2-4e28b48b1730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:39.171184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-71fbeff5-9368-4768-90a2-4e28b48b1730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:39.178585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-71fbeff5-9368-4768-90a2-4e28b48b1730 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.147493 Jul 28 09:14:39.179085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 228/472] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:39 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:40.199658 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-802fd7c2-9a39-47ca-9dfa-9e3d7ab5575a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:40.200519 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-802fd7c2-9a39-47ca-9dfa-9e3d7ab5575a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:40.206497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-802fd7c2-9a39-47ca-9dfa-9e3d7ab5575a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:40.206941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-802fd7c2-9a39-47ca-9dfa-9e3d7ab5575a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:40.207713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-802fd7c2-9a39-47ca-9dfa-9e3d7ab5575a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:40.208146 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-802fd7c2-9a39-47ca-9dfa-9e3d7ab5575a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:40.332068 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-802fd7c2-9a39-47ca-9dfa-9e3d7ab5575a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:40.339970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-802fd7c2-9a39-47ca-9dfa-9e3d7ab5575a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.144139 Jul 28 09:14:40.340525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 245/473] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:40 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:41.360021 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-afc6f131-f7b5-46a3-985d-0d84adca0764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:41.360619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-afc6f131-f7b5-46a3-985d-0d84adca0764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:41.367974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-afc6f131-f7b5-46a3-985d-0d84adca0764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:41.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-afc6f131-f7b5-46a3-985d-0d84adca0764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:41.369206 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-afc6f131-f7b5-46a3-985d-0d84adca0764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:41.369634 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-afc6f131-f7b5-46a3-985d-0d84adca0764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:41.498916 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-afc6f131-f7b5-46a3-985d-0d84adca0764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:41.506434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-afc6f131-f7b5-46a3-985d-0d84adca0764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.150262 Jul 28 09:14:41.506988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 229/474] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:41 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:42.526732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8f74c0b9-8673-4b07-8ede-c1434d667e4c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:42.527337 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8f74c0b9-8673-4b07-8ede-c1434d667e4c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:42.533296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8f74c0b9-8673-4b07-8ede-c1434d667e4c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:42.533735 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8f74c0b9-8673-4b07-8ede-c1434d667e4c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:42.534544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8f74c0b9-8673-4b07-8ede-c1434d667e4c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:42.534972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8f74c0b9-8673-4b07-8ede-c1434d667e4c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:42.660258 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8f74c0b9-8673-4b07-8ede-c1434d667e4c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:42.668275 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8f74c0b9-8673-4b07-8ede-c1434d667e4c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.145296 Jul 28 09:14:42.668834 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 246/475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:42 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:43.688837 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4ad6c179-98f7-40d7-939b-c2c2e7078573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:43.689446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4ad6c179-98f7-40d7-939b-c2c2e7078573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:43.696016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4ad6c179-98f7-40d7-939b-c2c2e7078573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:43.696560 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4ad6c179-98f7-40d7-939b-c2c2e7078573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:43.697295 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4ad6c179-98f7-40d7-939b-c2c2e7078573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:43.697766 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4ad6c179-98f7-40d7-939b-c2c2e7078573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:44.057181 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4ad6c179-98f7-40d7-939b-c2c2e7078573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:44.064578 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4ad6c179-98f7-40d7-939b-c2c2e7078573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.379536 Jul 28 09:14:44.065149 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 230/476] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:43 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:45.086220 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9c3a7f51-9c04-4222-b1d1-78460d2b1e7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:45.086936 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9c3a7f51-9c04-4222-b1d1-78460d2b1e7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:45.093450 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c3a7f51-9c04-4222-b1d1-78460d2b1e7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:45.093959 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c3a7f51-9c04-4222-b1d1-78460d2b1e7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:45.094726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c3a7f51-9c04-4222-b1d1-78460d2b1e7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:45.095296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c3a7f51-9c04-4222-b1d1-78460d2b1e7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:45.234744 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9c3a7f51-9c04-4222-b1d1-78460d2b1e7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:45.242421 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9c3a7f51-9c04-4222-b1d1-78460d2b1e7b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.160053 Jul 28 09:14:45.242992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 247/477] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:45 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:46.265139 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-00dabf0f-9f98-4b66-acb7-7ac445b5162b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:46.265930 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-00dabf0f-9f98-4b66-acb7-7ac445b5162b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:46.272938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-00dabf0f-9f98-4b66-acb7-7ac445b5162b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:46.273647 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-00dabf0f-9f98-4b66-acb7-7ac445b5162b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:46.274433 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-00dabf0f-9f98-4b66-acb7-7ac445b5162b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:46.275026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-00dabf0f-9f98-4b66-acb7-7ac445b5162b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:46.419089 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-00dabf0f-9f98-4b66-acb7-7ac445b5162b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:46.432338 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-00dabf0f-9f98-4b66-acb7-7ac445b5162b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.171370 Jul 28 09:14:46.433338 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 231/478] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:46 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:46.870584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-4d34bd9f-e5ac-4028-a438-171e14e60f8c req-a5ddb283-715e-4526-b3f1-e614f3e9a9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f77207-4c9e-4c6b-8948-d42f1f28c4aa", "name": "network-vif-plugged", "status": "completed", "tag": "433c3376-c310-4c2a-80fa-815d10d185aa"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:14:46.883001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=28 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:14:46.885725 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-4d34bd9f-e5ac-4028-a438-171e14e60f8c req-a5ddb283-715e-4526-b3f1-e614f3e9a9b7 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:46.886253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-4d34bd9f-e5ac-4028-a438-171e14e60f8c req-a5ddb283-715e-4526-b3f1-e614f3e9a9b7 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:46.899369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-4d34bd9f-e5ac-4028-a438-171e14e60f8c req-a5ddb283-715e-4526-b3f1-e614f3e9a9b7 service nova] Creating event network-vif-plugged:433c3376-c310-4c2a-80fa-815d10d185aa for instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa on hv-cinder-85124 Jul 28 09:14:46.905061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-4d34bd9f-e5ac-4028-a438-171e14e60f8c req-a5ddb283-715e-4526-b3f1-e614f3e9a9b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038400 Jul 28 09:14:46.906127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 248/479] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:14:47.180506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0b3b9d42-c0dc-45d3-9fb1-2b1e1a9c9b46 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:47.180996 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0b3b9d42-c0dc-45d3-9fb1-2b1e1a9c9b46 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:47.187196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0b3b9d42-c0dc-45d3-9fb1-2b1e1a9c9b46 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:47.187636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0b3b9d42-c0dc-45d3-9fb1-2b1e1a9c9b46 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:47.188389 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0b3b9d42-c0dc-45d3-9fb1-2b1e1a9c9b46 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:47.188814 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0b3b9d42-c0dc-45d3-9fb1-2b1e1a9c9b46 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:47.316827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-0b3b9d42-c0dc-45d3-9fb1-2b1e1a9c9b46 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lazy-loading 'services' on Instance uuid 3c8cfe61-231d-4a5f-a2df-76954e9e9385 {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:14:47.435094 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0b3b9d42-c0dc-45d3-9fb1-2b1e1a9c9b46 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385/os-volume_attachments/c514e0b5-51a3-4ad5-8fda-8003b8d69929" status: 202 len: 0 microversion: 2.1 time: 0.258372 Jul 28 09:14:47.435602 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 232/480] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:14:47 2022] DELETE /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385/os-volume_attachments/c514e0b5-51a3-4ad5-8fda-8003b8d69929 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:14:47.455407 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ada04161-813b-47e8-b64b-ed9a610c7a03 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:47.457157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ada04161-813b-47e8-b64b-ed9a610c7a03 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:47.464741 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ada04161-813b-47e8-b64b-ed9a610c7a03 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:47.465782 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ada04161-813b-47e8-b64b-ed9a610c7a03 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:47.466285 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ada04161-813b-47e8-b64b-ed9a610c7a03 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:47.466727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ada04161-813b-47e8-b64b-ed9a610c7a03 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:47.596588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ada04161-813b-47e8-b64b-ed9a610c7a03 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:47.604161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ada04161-813b-47e8-b64b-ed9a610c7a03 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.153949 Jul 28 09:14:47.604821 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 249/481] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:47 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:48.624861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f3fc926b-367f-428d-9592-7103b5043ead tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:48.625792 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f3fc926b-367f-428d-9592-7103b5043ead tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:48.632496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f3fc926b-367f-428d-9592-7103b5043ead tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:48.633498 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f3fc926b-367f-428d-9592-7103b5043ead tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:48.634299 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f3fc926b-367f-428d-9592-7103b5043ead tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:48.634737 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f3fc926b-367f-428d-9592-7103b5043ead tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:48.765678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f3fc926b-367f-428d-9592-7103b5043ead tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:48.773130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f3fc926b-367f-428d-9592-7103b5043ead tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1371 microversion: 2.1 time: 0.152420 Jul 28 09:14:48.774364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 233/482] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:48 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:49.794111 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f69bee7f-9892-4dd9-8989-11c5b7836379 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:49.794719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f69bee7f-9892-4dd9-8989-11c5b7836379 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:49.800627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f69bee7f-9892-4dd9-8989-11c5b7836379 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:49.801076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f69bee7f-9892-4dd9-8989-11c5b7836379 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:49.801865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f69bee7f-9892-4dd9-8989-11c5b7836379 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:49.802326 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f69bee7f-9892-4dd9-8989-11c5b7836379 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:49.931667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f69bee7f-9892-4dd9-8989-11c5b7836379 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:49.939392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f69bee7f-9892-4dd9-8989-11c5b7836379 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1564 microversion: 2.1 time: 0.149096 Jul 28 09:14:49.939891 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 250/483] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:49 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:49.959586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c4d82527-3947-4a95-af53-00f1cf967d46 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:49.960184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c4d82527-3947-4a95-af53-00f1cf967d46 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:49.967745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c4d82527-3947-4a95-af53-00f1cf967d46 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:49.968298 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c4d82527-3947-4a95-af53-00f1cf967d46 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:49.969141 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c4d82527-3947-4a95-af53-00f1cf967d46 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:49.969639 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c4d82527-3947-4a95-af53-00f1cf967d46 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:50.047708 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c4d82527-3947-4a95-af53-00f1cf967d46 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091882 Jul 28 09:14:50.048311 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 234/484] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 09:14:49 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:14:50.696041 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-70c90dbf-ca1a-4eab-b1b2-dfe79676b649 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:50.709693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70c90dbf-ca1a-4eab-b1b2-dfe79676b649 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:50.709693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70c90dbf-ca1a-4eab-b1b2-dfe79676b649 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:50.709693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70c90dbf-ca1a-4eab-b1b2-dfe79676b649 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:50.709693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70c90dbf-ca1a-4eab-b1b2-dfe79676b649 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:50.710394 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70c90dbf-ca1a-4eab-b1b2-dfe79676b649 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:50.743887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70c90dbf-ca1a-4eab-b1b2-dfe79676b649 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:14:50.839215 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-70c90dbf-ca1a-4eab-b1b2-dfe79676b649 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 204 len: 0 microversion: 2.1 time: 0.147099 Jul 28 09:14:50.841124 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 251/485] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:14:50 2022] DELETE /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:14:50.849175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c1b72f9d-540b-4bd0-93af-2f40677b3d23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:50.849775 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c1b72f9d-540b-4bd0-93af-2f40677b3d23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:50.857036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1b72f9d-540b-4bd0-93af-2f40677b3d23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:50.857478 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1b72f9d-540b-4bd0-93af-2f40677b3d23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:50.858264 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1b72f9d-540b-4bd0-93af-2f40677b3d23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:50.858862 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c1b72f9d-540b-4bd0-93af-2f40677b3d23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:51.050137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c1b72f9d-540b-4bd0-93af-2f40677b3d23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:51.060516 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c1b72f9d-540b-4bd0-93af-2f40677b3d23 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1513 microversion: 2.1 time: 0.214660 Jul 28 09:14:51.061123 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 235/486] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:50 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:51.206693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-94c6e594-6ad3-4cb1-81ce-55d16808aefa req-520c9d91-bf39-4382-bb03-39612bfee1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f77207-4c9e-4c6b-8948-d42f1f28c4aa", "tag": "433c3376-c310-4c2a-80fa-815d10d185aa"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:14:51.218998 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-94c6e594-6ad3-4cb1-81ce-55d16808aefa req-520c9d91-bf39-4382-bb03-39612bfee1cf service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:51.219557 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-94c6e594-6ad3-4cb1-81ce-55d16808aefa req-520c9d91-bf39-4382-bb03-39612bfee1cf service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:51.233437 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-94c6e594-6ad3-4cb1-81ce-55d16808aefa req-520c9d91-bf39-4382-bb03-39612bfee1cf service nova] Creating event network-changed:433c3376-c310-4c2a-80fa-815d10d185aa for instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa on hv-cinder-85124 Jul 28 09:14:51.238393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-94c6e594-6ad3-4cb1-81ce-55d16808aefa req-520c9d91-bf39-4382-bb03-39612bfee1cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035732 Jul 28 09:14:51.238985 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 252/487] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:14:52.082025 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-13e24967-2a3b-4f4b-9997-bd2f93d11f03 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:52.082634 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-13e24967-2a3b-4f4b-9997-bd2f93d11f03 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:52.089466 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-13e24967-2a3b-4f4b-9997-bd2f93d11f03 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:52.089936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-13e24967-2a3b-4f4b-9997-bd2f93d11f03 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:52.090698 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-13e24967-2a3b-4f4b-9997-bd2f93d11f03 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:52.091297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-13e24967-2a3b-4f4b-9997-bd2f93d11f03 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:52.275556 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-13e24967-2a3b-4f4b-9997-bd2f93d11f03 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:52.285002 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-13e24967-2a3b-4f4b-9997-bd2f93d11f03 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1513 microversion: 2.1 time: 0.206830 Jul 28 09:14:52.285583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 236/488] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:52 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:14:53.308624 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dddaec24-9e95-4065-a0f3-f1b8c290ed76 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:53.309488 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dddaec24-9e95-4065-a0f3-f1b8c290ed76 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:53.316140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dddaec24-9e95-4065-a0f3-f1b8c290ed76 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:53.316795 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dddaec24-9e95-4065-a0f3-f1b8c290ed76 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:53.317697 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dddaec24-9e95-4065-a0f3-f1b8c290ed76 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:53.318255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dddaec24-9e95-4065-a0f3-f1b8c290ed76 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:53.696399 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dddaec24-9e95-4065-a0f3-f1b8c290ed76 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:53.704058 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dddaec24-9e95-4065-a0f3-f1b8c290ed76 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1513 microversion: 2.1 time: 0.400655 Jul 28 09:14:53.704622 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 253/489] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:53 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1513 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:53.905098 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-1cc9edc9-b0ea-4e47-8e60-592f77d9daa4 req-fd2335e1-ac77-49f4-9c52-a3f4a45049d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8cfe61-231d-4a5f-a2df-76954e9e9385", "name": "network-vif-deleted", "tag": "1b378db7-2753-45d5-9a61-6ce631da79d2"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:14:53.916610 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-1cc9edc9-b0ea-4e47-8e60-592f77d9daa4 req-fd2335e1-ac77-49f4-9c52-a3f4a45049d3 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:53.917048 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-1cc9edc9-b0ea-4e47-8e60-592f77d9daa4 req-fd2335e1-ac77-49f4-9c52-a3f4a45049d3 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:53.928560 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-1cc9edc9-b0ea-4e47-8e60-592f77d9daa4 req-fd2335e1-ac77-49f4-9c52-a3f4a45049d3 service nova] Creating event network-vif-deleted:1b378db7-2753-45d5-9a61-6ce631da79d2 for instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 on hv-cinder-85124 Jul 28 09:14:53.933569 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-1cc9edc9-b0ea-4e47-8e60-592f77d9daa4 req-fd2335e1-ac77-49f4-9c52-a3f4a45049d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032316 Jul 28 09:14:53.934212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 237/490] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:14:54.725501 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:54.726135 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:54.732074 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:54.732522 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:54.733282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:54.733715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:54.764576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:54.765018 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:54.765459 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lazy-loading 'fault' on Instance uuid 3c8cfe61-231d-4a5f-a2df-76954e9e9385 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:14:54.807819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:14:54.815107 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-946bd589-ef76-41ab-942a-d9d245deaf70 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 200 len: 1308 microversion: 2.1 time: 0.093435 Jul 28 09:14:54.815658 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 254/491] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:54 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:14:55.837915 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:14:55.838639 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: 3c8cfe61-231d-4a5f-a2df-76954e9e9385] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:14:55.844890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:55.845336 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:55.846113 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:14:55.846583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:14:55.860258 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] HTTP exception thrown: Instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 could not be found. Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Request method failure captured: Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 HTTP/1.1 Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lMUW2efXv7-fYLalD3n8EApsvdoQcAF38_SmGIBTCkAAvYGmrad5w4A_n-j5Pq2L6-dS3-AJlmN0YMVvNKHZg9oAFo5saMDlyBXgPwKnMP3ModOmVl4Id_7rQZfCMrPri6cbRszqIVJjYwJCy-4eCC2BedJ6jksNFWNhG002P8zhKo Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 39a7fbb2f3ca405bbaa394825b4a3e73 Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesSnapshotTestJSON-523367942 Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:14:55.861811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39a7fbb2f3ca405bbaa394825b4a3e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39a7fbb2f3ca405bbaa394825b4a3e73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39a7fbb2f3ca405bbaa394825b4a3e73", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39a7fbb2f3ca405bbaa394825b4a3e73"}]}] Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesSnapshotTestJSON-523367942 Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 39a7fbb2f3ca405bbaa394825b4a3e73 Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-523367942 Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesSnapshotTestJSON-523367942-project Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 79e4add99b984c25b04553927bed7cb5 Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesSnapshotTestJSON-523367942-project Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 could not be found. Jul 28 09:14:55.863368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '3c8cfe61-231d-4a5f-a2df-76954e9e9385'} Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 could not be found. Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:14:55.864195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 could not be found. Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 could not be found. Jul 28 09:14:55.865675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:14:55.866995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Returning 404 to user: Instance 3c8cfe61-231d-4a5f-a2df-76954e9e9385 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:14:55.866995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3bf280cf-1cef-4f35-b3bf-c63c4f03ca5a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385" status: 404 len: 111 microversion: 2.1 time: 0.030480 Jul 28 09:14:55.866995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 238/492] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:14:55 2022] GET /compute/v2.1/servers/3c8cfe61-231d-4a5f-a2df-76954e9e9385 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:15:11.983263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1190700336", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "networks": [{"uuid": "cb35dd40-bdfb-4501-b560-84079bfe68cc"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:15:11.992458 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:11.993118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:12.039338 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] validate_networks() for [('cb35dd40-bdfb-4501-b560-84079bfe68cc', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:15:12.416385 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:15:12.416808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:15:12.417420 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:15:12.417831 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:15:12.418270 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:15:12.427368 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:12.427812 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:12.428601 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:12.429060 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:12.445013 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Getting quotas for project 39a7fbb2f3ca405bbaa394825b4a3e73. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:15:12.448857 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Getting quotas for user 79e4add99b984c25b04553927bed7cb5 and project 39a7fbb2f3ca405bbaa394825b4a3e73. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:15:12.459883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:15:12.462647 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:15:12.512129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-14543c85-3b9e-4c7a-bb33-3b66d4dca43b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532550 Jul 28 09:15:12.512701 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 255/493] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:15:12.524193 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-96e6a1e8-1d9c-45ee-a894-c4eead93223b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:12.524855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-96e6a1e8-1d9c-45ee-a894-c4eead93223b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:12.527151 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=21 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:12.528233 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:12.591789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-96e6a1e8-1d9c-45ee-a894-c4eead93223b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:12.598370 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-96e6a1e8-1d9c-45ee-a894-c4eead93223b tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1219 microversion: 2.1 time: 0.078806 Jul 28 09:15:12.598936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 239/494] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:12 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:15:13.620452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dae1c0fc-fc80-430f-bbb9-ed4a7eb1451a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:13.621066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dae1c0fc-fc80-430f-bbb9-ed4a7eb1451a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:13.628025 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dae1c0fc-fc80-430f-bbb9-ed4a7eb1451a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:13.628676 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dae1c0fc-fc80-430f-bbb9-ed4a7eb1451a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:13.630547 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dae1c0fc-fc80-430f-bbb9-ed4a7eb1451a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:13.631061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dae1c0fc-fc80-430f-bbb9-ed4a7eb1451a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:13.718059 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dae1c0fc-fc80-430f-bbb9-ed4a7eb1451a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:13.734590 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dae1c0fc-fc80-430f-bbb9-ed4a7eb1451a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1271 microversion: 2.1 time: 0.118407 Jul 28 09:15:13.735483 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 256/495] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:13 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:14.758525 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8bfeb281-2156-47d8-b4b7-de149d1b2272 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:14.759984 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8bfeb281-2156-47d8-b4b7-de149d1b2272 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:14.767966 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8bfeb281-2156-47d8-b4b7-de149d1b2272 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:14.768723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8bfeb281-2156-47d8-b4b7-de149d1b2272 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:14.769612 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8bfeb281-2156-47d8-b4b7-de149d1b2272 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:14.770233 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8bfeb281-2156-47d8-b4b7-de149d1b2272 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:15.036706 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8bfeb281-2156-47d8-b4b7-de149d1b2272 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:15.044828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8bfeb281-2156-47d8-b4b7-de149d1b2272 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.291126 Jul 28 09:15:15.045399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 240/496] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:14 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:15.280551 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-baad056f-fa89-42cf-abcd-451cb7d594c7 req-6b160e01-f1aa-4333-9669-9dc8fd16e287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7987a34-1e5e-4049-9acf-82938bd8f226", "tag": "4f936277-e00a-481e-a8ac-02e282230e9a"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:15:15.311770 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-baad056f-fa89-42cf-abcd-451cb7d594c7 req-6b160e01-f1aa-4333-9669-9dc8fd16e287 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:15.312329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-baad056f-fa89-42cf-abcd-451cb7d594c7 req-6b160e01-f1aa-4333-9669-9dc8fd16e287 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:15.323920 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-baad056f-fa89-42cf-abcd-451cb7d594c7 req-6b160e01-f1aa-4333-9669-9dc8fd16e287 service nova] Creating event network-changed:4f936277-e00a-481e-a8ac-02e282230e9a for instance e7987a34-1e5e-4049-9acf-82938bd8f226 on hv-cinder-85124 Jul 28 09:15:15.330442 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-baad056f-fa89-42cf-abcd-451cb7d594c7 req-6b160e01-f1aa-4333-9669-9dc8fd16e287 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052815 Jul 28 09:15:15.332785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 257/497] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:15:16.066670 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-af4f2530-0ed7-44a7-9999-15e17fd0af9a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:16.067289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-af4f2530-0ed7-44a7-9999-15e17fd0af9a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:16.074303 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-af4f2530-0ed7-44a7-9999-15e17fd0af9a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:16.074749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-af4f2530-0ed7-44a7-9999-15e17fd0af9a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:16.075502 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-af4f2530-0ed7-44a7-9999-15e17fd0af9a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:16.076193 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-af4f2530-0ed7-44a7-9999-15e17fd0af9a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:16.218820 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-af4f2530-0ed7-44a7-9999-15e17fd0af9a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:16.226558 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-af4f2530-0ed7-44a7-9999-15e17fd0af9a tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.163898 Jul 28 09:15:16.227126 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 241/498] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:16 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:17.248742 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2dc71258-a3fe-4597-ada1-7da015bcd797 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:17.249350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2dc71258-a3fe-4597-ada1-7da015bcd797 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:17.255497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2dc71258-a3fe-4597-ada1-7da015bcd797 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:17.255934 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2dc71258-a3fe-4597-ada1-7da015bcd797 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:17.256685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2dc71258-a3fe-4597-ada1-7da015bcd797 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:17.257113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2dc71258-a3fe-4597-ada1-7da015bcd797 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:17.390514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2dc71258-a3fe-4597-ada1-7da015bcd797 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:17.398552 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2dc71258-a3fe-4597-ada1-7da015bcd797 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.153681 Jul 28 09:15:17.399169 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 258/499] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:17 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:18.422509 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dc19c012-b251-4b3d-bb19-529eba361cfc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:18.423112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dc19c012-b251-4b3d-bb19-529eba361cfc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:18.429981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dc19c012-b251-4b3d-bb19-529eba361cfc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:18.430366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dc19c012-b251-4b3d-bb19-529eba361cfc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:18.431128 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dc19c012-b251-4b3d-bb19-529eba361cfc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:18.431641 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dc19c012-b251-4b3d-bb19-529eba361cfc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:18.578231 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dc19c012-b251-4b3d-bb19-529eba361cfc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:18.590136 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dc19c012-b251-4b3d-bb19-529eba361cfc tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.170212 Jul 28 09:15:18.590136 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 242/500] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:18 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:19.622412 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-692da545-5033-460b-b4c7-6b40943a5593 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:19.623165 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-692da545-5033-460b-b4c7-6b40943a5593 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:19.629680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-692da545-5033-460b-b4c7-6b40943a5593 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:19.629986 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-692da545-5033-460b-b4c7-6b40943a5593 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:19.630747 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-692da545-5033-460b-b4c7-6b40943a5593 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:19.631182 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-692da545-5033-460b-b4c7-6b40943a5593 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:19.799263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-692da545-5033-460b-b4c7-6b40943a5593 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:19.806675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-692da545-5033-460b-b4c7-6b40943a5593 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.188012 Jul 28 09:15:19.807223 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 259/501] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:19 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:20.827564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b37a27a9-76c2-4479-8d75-efff52b09dc5 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:20.828166 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b37a27a9-76c2-4479-8d75-efff52b09dc5 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:20.834612 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b37a27a9-76c2-4479-8d75-efff52b09dc5 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:20.835057 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b37a27a9-76c2-4479-8d75-efff52b09dc5 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:20.835801 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b37a27a9-76c2-4479-8d75-efff52b09dc5 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:20.836234 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b37a27a9-76c2-4479-8d75-efff52b09dc5 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:20.969366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b37a27a9-76c2-4479-8d75-efff52b09dc5 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:20.978008 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b37a27a9-76c2-4479-8d75-efff52b09dc5 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.154216 Jul 28 09:15:20.978578 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 243/502] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:20 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:21.716708 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-51fa1a03-d0ab-4f33-b2b1-3b10c3265b44 req-7525e5d7-3299-4d9e-bca2-bd1f18a7fcf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7987a34-1e5e-4049-9acf-82938bd8f226", "name": "network-vif-plugged", "status": "completed", "tag": "4f936277-e00a-481e-a8ac-02e282230e9a"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:15:21.727160 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-51fa1a03-d0ab-4f33-b2b1-3b10c3265b44 req-7525e5d7-3299-4d9e-bca2-bd1f18a7fcf8 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:21.727603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-51fa1a03-d0ab-4f33-b2b1-3b10c3265b44 req-7525e5d7-3299-4d9e-bca2-bd1f18a7fcf8 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:21.740860 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-51fa1a03-d0ab-4f33-b2b1-3b10c3265b44 req-7525e5d7-3299-4d9e-bca2-bd1f18a7fcf8 service nova] Creating event network-vif-plugged:4f936277-e00a-481e-a8ac-02e282230e9a for instance e7987a34-1e5e-4049-9acf-82938bd8f226 on hv-cinder-85124 Jul 28 09:15:21.745774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-51fa1a03-d0ab-4f33-b2b1-3b10c3265b44 req-7525e5d7-3299-4d9e-bca2-bd1f18a7fcf8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 Jul 28 09:15:21.746610 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 260/503] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:15:21.999048 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2932011a-b5bd-420f-82fd-ff607f395986 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:21.999946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2932011a-b5bd-420f-82fd-ff607f395986 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:22.008605 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2932011a-b5bd-420f-82fd-ff607f395986 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:22.009046 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2932011a-b5bd-420f-82fd-ff607f395986 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:22.009805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2932011a-b5bd-420f-82fd-ff607f395986 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:22.010258 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2932011a-b5bd-420f-82fd-ff607f395986 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:22.177279 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2932011a-b5bd-420f-82fd-ff607f395986 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:22.185362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2932011a-b5bd-420f-82fd-ff607f395986 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.190226 Jul 28 09:15:22.186261 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 244/504] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:21 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:23.209807 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cde3c0ab-572f-4860-b2d6-0a129960bd40 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:23.210530 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cde3c0ab-572f-4860-b2d6-0a129960bd40 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:23.213106 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:23.213755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:23.220432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cde3c0ab-572f-4860-b2d6-0a129960bd40 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:23.220878 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cde3c0ab-572f-4860-b2d6-0a129960bd40 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:23.221652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cde3c0ab-572f-4860-b2d6-0a129960bd40 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:23.222105 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cde3c0ab-572f-4860-b2d6-0a129960bd40 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:23.355388 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cde3c0ab-572f-4860-b2d6-0a129960bd40 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:23.362718 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cde3c0ab-572f-4860-b2d6-0a129960bd40 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.157038 Jul 28 09:15:23.363274 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 261/505] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:23 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:24.383507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-20971420-9c01-4dfd-9dc2-d0678639c508 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:24.384117 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-20971420-9c01-4dfd-9dc2-d0678639c508 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:24.386040 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:24.392052 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-20971420-9c01-4dfd-9dc2-d0678639c508 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:24.392503 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-20971420-9c01-4dfd-9dc2-d0678639c508 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:24.393274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-20971420-9c01-4dfd-9dc2-d0678639c508 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:24.393712 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-20971420-9c01-4dfd-9dc2-d0678639c508 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:24.530132 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-20971420-9c01-4dfd-9dc2-d0678639c508 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:24.537548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-20971420-9c01-4dfd-9dc2-d0678639c508 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1319 microversion: 2.1 time: 0.157919 Jul 28 09:15:24.538141 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 245/506] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:24 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:25.558902 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d5f449b3-6159-4761-b5f3-24024beb00b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:25.559446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d5f449b3-6159-4761-b5f3-24024beb00b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:25.565376 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5f449b3-6159-4761-b5f3-24024beb00b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:25.565823 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5f449b3-6159-4761-b5f3-24024beb00b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:25.566609 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5f449b3-6159-4761-b5f3-24024beb00b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:25.567043 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5f449b3-6159-4761-b5f3-24024beb00b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:25.699092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d5f449b3-6159-4761-b5f3-24024beb00b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:25.706859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d5f449b3-6159-4761-b5f3-24024beb00b9 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1507 microversion: 2.1 time: 0.152030 Jul 28 09:15:25.707417 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 262/507] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:25 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:15:25.726912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f4348c55-4cf8-4b12-9032-731511c47171 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "142bbb45-4d1f-4e48-8b8d-c811c7fff7d2", "device": "/dev/sdb"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:15:25.729866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f4348c55-4cf8-4b12-9032-731511c47171 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:25.736208 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f4348c55-4cf8-4b12-9032-731511c47171 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:25.736647 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f4348c55-4cf8-4b12-9032-731511c47171 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:25.737391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f4348c55-4cf8-4b12-9032-731511c47171 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:25.737818 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f4348c55-4cf8-4b12-9032-731511c47171 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:26.014925 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f4348c55-4cf8-4b12-9032-731511c47171 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "POST /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291760 Jul 28 09:15:26.015579 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 246/508] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:15:25 2022] POST /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:15:56.686878 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2240321e-26fc-41f3-a502-a75b2855c076 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:56.687416 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2240321e-26fc-41f3-a502-a75b2855c076 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:56.689328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:56.690104 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=36 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:56.695898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2240321e-26fc-41f3-a502-a75b2855c076 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:56.696340 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2240321e-26fc-41f3-a502-a75b2855c076 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:56.697092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2240321e-26fc-41f3-a502-a75b2855c076 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:56.697532 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2240321e-26fc-41f3-a502-a75b2855c076 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:56.828558 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-2240321e-26fc-41f3-a502-a75b2855c076 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lazy-loading 'services' on Instance uuid e7987a34-1e5e-4049-9acf-82938bd8f226 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:15:56.943471 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2240321e-26fc-41f3-a502-a75b2855c076 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226/os-volume_attachments/142bbb45-4d1f-4e48-8b8d-c811c7fff7d2" status: 202 len: 0 microversion: 2.1 time: 0.260249 Jul 28 09:15:56.944053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 263/509] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:15:56 2022] DELETE /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226/os-volume_attachments/142bbb45-4d1f-4e48-8b8d-c811c7fff7d2 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:15:59.118453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=18 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:59.119346 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:15:59.123594 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2379bd1b-2fc8-4485-8904-33cc846a528c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:59.124155 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2379bd1b-2fc8-4485-8904-33cc846a528c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:59.131923 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2379bd1b-2fc8-4485-8904-33cc846a528c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:59.132370 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2379bd1b-2fc8-4485-8904-33cc846a528c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:59.133131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2379bd1b-2fc8-4485-8904-33cc846a528c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:59.133564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2379bd1b-2fc8-4485-8904-33cc846a528c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:59.160441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2379bd1b-2fc8-4485-8904-33cc846a528c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:15:59.236163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2379bd1b-2fc8-4485-8904-33cc846a528c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 204 len: 0 microversion: 2.1 time: 0.118987 Jul 28 09:15:59.236781 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 247/510] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:15:59 2022] DELETE /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:15:59.245596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d6003b3f-9aec-466e-8132-f34358f5b967 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:15:59.246329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d6003b3f-9aec-466e-8132-f34358f5b967 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:15:59.253115 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d6003b3f-9aec-466e-8132-f34358f5b967 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:59.253564 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d6003b3f-9aec-466e-8132-f34358f5b967 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:59.254368 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d6003b3f-9aec-466e-8132-f34358f5b967 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:15:59.254809 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d6003b3f-9aec-466e-8132-f34358f5b967 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:15:59.387546 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d6003b3f-9aec-466e-8132-f34358f5b967 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:15:59.395662 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d6003b3f-9aec-466e-8132-f34358f5b967 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1513 microversion: 2.1 time: 0.154207 Jul 28 09:15:59.396226 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 264/511] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:15:59 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:00.417112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-845f153b-ef67-4e87-bfb3-f128cd32d37c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:00.417858 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-845f153b-ef67-4e87-bfb3-f128cd32d37c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:00.424332 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-845f153b-ef67-4e87-bfb3-f128cd32d37c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:00.424779 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-845f153b-ef67-4e87-bfb3-f128cd32d37c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:00.425537 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-845f153b-ef67-4e87-bfb3-f128cd32d37c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:00.426014 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-845f153b-ef67-4e87-bfb3-f128cd32d37c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:00.559194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-845f153b-ef67-4e87-bfb3-f128cd32d37c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:00.566798 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-845f153b-ef67-4e87-bfb3-f128cd32d37c tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1513 microversion: 2.1 time: 0.153807 Jul 28 09:16:00.567292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 248/512] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:00 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:01.588818 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3b0558eb-7a8c-44b9-9b44-b023a9c41817 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:01.589429 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3b0558eb-7a8c-44b9-9b44-b023a9c41817 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:01.595652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b0558eb-7a8c-44b9-9b44-b023a9c41817 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:01.596099 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b0558eb-7a8c-44b9-9b44-b023a9c41817 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:01.596858 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b0558eb-7a8c-44b9-9b44-b023a9c41817 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:01.597290 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b0558eb-7a8c-44b9-9b44-b023a9c41817 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:01.727538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3b0558eb-7a8c-44b9-9b44-b023a9c41817 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:01.735613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3b0558eb-7a8c-44b9-9b44-b023a9c41817 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1513 microversion: 2.1 time: 0.150658 Jul 28 09:16:01.736213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 265/513] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:01 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:02.192915 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-da34a0bf-65e0-4aca-9a46-aea93d759fd0 req-843ea630-55d1-4e96-a42e-37ab5b472839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7987a34-1e5e-4049-9acf-82938bd8f226", "name": "network-vif-deleted", "tag": "4f936277-e00a-481e-a8ac-02e282230e9a"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:02.203431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-da34a0bf-65e0-4aca-9a46-aea93d759fd0 req-843ea630-55d1-4e96-a42e-37ab5b472839 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:02.203869 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-da34a0bf-65e0-4aca-9a46-aea93d759fd0 req-843ea630-55d1-4e96-a42e-37ab5b472839 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:02.216684 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-da34a0bf-65e0-4aca-9a46-aea93d759fd0 req-843ea630-55d1-4e96-a42e-37ab5b472839 service nova] Creating event network-vif-deleted:4f936277-e00a-481e-a8ac-02e282230e9a for instance e7987a34-1e5e-4049-9acf-82938bd8f226 on hv-cinder-85124 Jul 28 09:16:02.221415 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-da34a0bf-65e0-4aca-9a46-aea93d759fd0 req-843ea630-55d1-4e96-a42e-37ab5b472839 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032206 Jul 28 09:16:02.222009 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 249/514] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:02.756900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-747825d7-6b2c-4124-a6ea-90fd88c6d8a8 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:02.757516 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-747825d7-6b2c-4124-a6ea-90fd88c6d8a8 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:02.763386 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-747825d7-6b2c-4124-a6ea-90fd88c6d8a8 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:02.763828 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-747825d7-6b2c-4124-a6ea-90fd88c6d8a8 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:02.764582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-747825d7-6b2c-4124-a6ea-90fd88c6d8a8 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:02.765007 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-747825d7-6b2c-4124-a6ea-90fd88c6d8a8 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:02.826809 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-747825d7-6b2c-4124-a6ea-90fd88c6d8a8 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:02.834677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-747825d7-6b2c-4124-a6ea-90fd88c6d8a8 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1471 microversion: 2.1 time: 0.081699 Jul 28 09:16:02.835232 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 266/515] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:02 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1471 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:03.856947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-30c15a1f-afa2-40fa-b3b9-8f75aad46efe tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:03.857629 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-30c15a1f-afa2-40fa-b3b9-8f75aad46efe tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:03.864314 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-30c15a1f-afa2-40fa-b3b9-8f75aad46efe tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:03.864755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-30c15a1f-afa2-40fa-b3b9-8f75aad46efe tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:03.865500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-30c15a1f-afa2-40fa-b3b9-8f75aad46efe tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:03.865951 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-30c15a1f-afa2-40fa-b3b9-8f75aad46efe tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:03.929143 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-30c15a1f-afa2-40fa-b3b9-8f75aad46efe tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:03.936586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-30c15a1f-afa2-40fa-b3b9-8f75aad46efe tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1471 microversion: 2.1 time: 0.084241 Jul 28 09:16:03.937184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 250/516] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:03 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:04.958600 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fa40c5cd-11bb-47cc-8ca1-3a659c6cdff0 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:04.959207 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fa40c5cd-11bb-47cc-8ca1-3a659c6cdff0 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:04.965125 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fa40c5cd-11bb-47cc-8ca1-3a659c6cdff0 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:04.965518 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fa40c5cd-11bb-47cc-8ca1-3a659c6cdff0 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:04.966301 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fa40c5cd-11bb-47cc-8ca1-3a659c6cdff0 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:04.966743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fa40c5cd-11bb-47cc-8ca1-3a659c6cdff0 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:05.027170 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fa40c5cd-11bb-47cc-8ca1-3a659c6cdff0 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:05.035188 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fa40c5cd-11bb-47cc-8ca1-3a659c6cdff0 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1304 microversion: 2.1 time: 0.080444 Jul 28 09:16:05.035743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 267/517] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:04 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1304 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:06.056404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:06.057034 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:06.063685 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:06.064198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:06.064974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:06.065468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:06.102680 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:06.103126 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:06.103573 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lazy-loading 'fault' on Instance uuid e7987a34-1e5e-4049-9acf-82938bd8f226 {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:16:06.147782 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e4add99b984c25b04553927bed7cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39a7fbb2f3ca405bbaa394825b4a3e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:06.155544 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3d92775f-d042-4cbd-91a6-3c633317afff tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 200 len: 1309 microversion: 2.1 time: 0.103357 Jul 28 09:16:06.156731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 251/518] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:06 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:07.176543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:07.177079 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] [instance: e7987a34-1e5e-4049-9acf-82938bd8f226] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:07.183157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:07.183606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:07.184367 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:07.184805 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:07.197905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] HTTP exception thrown: Instance e7987a34-1e5e-4049-9acf-82938bd8f226 could not be found. Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Request method failure captured: Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 HTTP/1.1 Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lMUW2efXv7-fYLalD3n8EApsvdoQcAF38_SmGIBTCkAAvYGmrad5w4A_n-j5Pq2L6-dS3-AJlmN0YMVvNKHZg9oAFo5saMDlyBXgPwKnMP3ModOmVl4Id_7rQZfCMrPri6cbRszqIVJjYwJCy-4eCC2BedJ6jksNFWNhG002P8zhKo Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 39a7fbb2f3ca405bbaa394825b4a3e73 Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesSnapshotTestJSON-523367942 Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:16:07.200100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39a7fbb2f3ca405bbaa394825b4a3e73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39a7fbb2f3ca405bbaa394825b4a3e73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39a7fbb2f3ca405bbaa394825b4a3e73", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39a7fbb2f3ca405bbaa394825b4a3e73"}]}] Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-VolumesSnapshotTestJSON-523367942 Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 39a7fbb2f3ca405bbaa394825b4a3e73 Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-523367942 Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-VolumesSnapshotTestJSON-523367942-project Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: 79e4add99b984c25b04553927bed7cb5 Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-VolumesSnapshotTestJSON-523367942-project Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance e7987a34-1e5e-4049-9acf-82938bd8f226 could not be found. Jul 28 09:16:07.201913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'e7987a34-1e5e-4049-9acf-82938bd8f226'} Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7987a34-1e5e-4049-9acf-82938bd8f226 could not be found. Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:16:07.202781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7987a34-1e5e-4049-9acf-82938bd8f226 could not be found. Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7987a34-1e5e-4049-9acf-82938bd8f226 could not be found. Jul 28 09:16:07.204803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:16:07.206468 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] Returning 404 to user: Instance e7987a34-1e5e-4049-9acf-82938bd8f226 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:16:07.206468 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ab2e6df5-e895-44f6-a15d-c74905d0bc55 tempest-VolumesSnapshotTestJSON-523367942 tempest-VolumesSnapshotTestJSON-523367942-project] 10.222.0.48 "GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226" status: 404 len: 111 microversion: 2.1 time: 0.028812 Jul 28 09:16:07.206468 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 268/519] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:07 2022] GET /compute/v2.1/servers/e7987a34-1e5e-4049-9acf-82938bd8f226 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:16:07.601256 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7efb2667-c4b5-4f39-b40c-a188ed6690bc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:07.601808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7efb2667-c4b5-4f39-b40c-a188ed6690bc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:07.608096 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7efb2667-c4b5-4f39-b40c-a188ed6690bc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:07.608540 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7efb2667-c4b5-4f39-b40c-a188ed6690bc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:07.609283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7efb2667-c4b5-4f39-b40c-a188ed6690bc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:07.609711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7efb2667-c4b5-4f39-b40c-a188ed6690bc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:07.632491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7efb2667-c4b5-4f39-b40c-a188ed6690bc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/ips" status: 200 len: 146 microversion: 2.1 time: 0.035082 Jul 28 09:16:07.633042 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 252/520] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:16:07 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:14.551277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5e667b81-e907-4c8f-888f-af97acc34813 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8ffcace-88ce-4ac0-b083-6b7dc465dca1"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:14.553676 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5e667b81-e907-4c8f-888f-af97acc34813 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:14.559646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e667b81-e907-4c8f-888f-af97acc34813 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:14.560089 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e667b81-e907-4c8f-888f-af97acc34813 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:14.560838 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e667b81-e907-4c8f-888f-af97acc34813 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:14.561265 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e667b81-e907-4c8f-888f-af97acc34813 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:14.849700 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5e667b81-e907-4c8f-888f-af97acc34813 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302141 Jul 28 09:16:14.850359 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 269/521] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:16:14 2022] POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:15.636611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d07343e2-4b0f-4d02-ba5d-8c03eae30047 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:15.639689 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d07343e2-4b0f-4d02-ba5d-8c03eae30047 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:15.648323 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d07343e2-4b0f-4d02-ba5d-8c03eae30047 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:15.648775 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d07343e2-4b0f-4d02-ba5d-8c03eae30047 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:15.649545 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d07343e2-4b0f-4d02-ba5d-8c03eae30047 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:15.650011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d07343e2-4b0f-4d02-ba5d-8c03eae30047 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:15.778308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d07343e2-4b0f-4d02-ba5d-8c03eae30047 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/action" status: 200 len: 30067 microversion: 2.1 time: 0.146368 Jul 28 09:16:15.782958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 253/522] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:16:15 2022] POST /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/action => generated 30067 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:16:16.082822 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ad7e6ee2-1a72-4676-8052-caa00c53870d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:16.083409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ad7e6ee2-1a72-4676-8052-caa00c53870d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:16.090350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ad7e6ee2-1a72-4676-8052-caa00c53870d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:16.090805 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ad7e6ee2-1a72-4676-8052-caa00c53870d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:16.091744 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ad7e6ee2-1a72-4676-8052-caa00c53870d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:16.092239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ad7e6ee2-1a72-4676-8052-caa00c53870d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:16.117489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ad7e6ee2-1a72-4676-8052-caa00c53870d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/ips" status: 200 len: 151 microversion: 2.20 time: 0.040384 Jul 28 09:16:16.118095 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 270/523] 10.222.0.48 () {60 vars in 1289 bytes} [Thu Jul 28 09:16:16 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:16:19.432803 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-019dbafd-af8c-4fa9-993c-d30ff0dc7e82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:19.434027 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-019dbafd-af8c-4fa9-993c-d30ff0dc7e82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:19.441574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-019dbafd-af8c-4fa9-993c-d30ff0dc7e82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:19.442047 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-019dbafd-af8c-4fa9-993c-d30ff0dc7e82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:19.442809 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-019dbafd-af8c-4fa9-993c-d30ff0dc7e82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:19.443244 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-019dbafd-af8c-4fa9-993c-d30ff0dc7e82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:19.467211 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-019dbafd-af8c-4fa9-993c-d30ff0dc7e82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lazy-loading 'flavor' on Instance uuid 145d502e-eb34-435a-8b8c-2ea6264d1506 {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:16:19.817187 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-019dbafd-af8c-4fa9-993c-d30ff0dc7e82 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/action" status: 202 len: 0 microversion: 2.20 time: 0.388368 Jul 28 09:16:19.817797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 254/524] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 09:16:19 2022] POST /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:16:19.826124 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:19.826999 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:19.834028 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:19.834478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:19.835244 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:19.835678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:20.073255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:20.082116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:20.083598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:20.084741 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e0c89766-b13e-4ca1-886a-eddfc93551c3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.262520 Jul 28 09:16:20.085284 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 271/525] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:19 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:21.107678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:21.108360 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:21.114520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:21.114959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:21.115703 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:21.116130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:21.246959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:21.255362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:21.256951 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:21.258196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b4e45889-1157-4c86-8b73-a9bb99921198 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.155200 Jul 28 09:16:21.258821 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 255/526] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:21 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:22.281667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:22.282312 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:22.288927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:22.289373 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:22.290170 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:22.290610 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:22.416497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:22.424733 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:22.426253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:22.427392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ffdbbb72-1f12-4967-a013-edec2b4ad05d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.149600 Jul 28 09:16:22.427952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 272/527] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:22 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:23.450898 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:23.451428 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:23.458884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:23.459325 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:23.460076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:23.460501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:23.585366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:23.593198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:23.594758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:23.595904 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7aae08d2-ae9c-41c2-a4e1-be17b43aa5de tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.148940 Jul 28 09:16:23.596452 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 256/528] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:23 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:24.618923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:24.619554 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:24.626172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:24.626589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:24.627355 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:24.627792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:24.813225 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:24.821647 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:24.823445 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:24.824609 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aa04a84e-254a-417f-a84a-165b34428a07 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.209570 Jul 28 09:16:24.825555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 273/529] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:24 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:25.580231 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ee097c21-e708-4627-94b4-4665b4c52842 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:25.586458 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ee097c21-e708-4627-94b4-4665b4c52842 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:25.586909 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ee097c21-e708-4627-94b4-4665b4c52842 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:25.646990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ee097c21-e708-4627-94b4-4665b4c52842 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Going to try to stop instance {{(pid=117863) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 09:16:25.691022 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ee097c21-e708-4627-94b4-4665b4c52842 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/action" status: 202 len: 0 microversion: 2.1 time: 0.115209 Jul 28 09:16:25.695334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 257/530] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:16:25 2022] POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:16:25.700614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-05aae83a-2f72-4cca-b514-ec44eda0335c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:25.701628 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-05aae83a-2f72-4cca-b514-ec44eda0335c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:25.718040 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05aae83a-2f72-4cca-b514-ec44eda0335c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:25.718736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05aae83a-2f72-4cca-b514-ec44eda0335c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:25.719512 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05aae83a-2f72-4cca-b514-ec44eda0335c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:25.719952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05aae83a-2f72-4cca-b514-ec44eda0335c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:25.848911 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:25.849603 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:25.855720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:25.856308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:25.856982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:25.857405 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:25.859910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-05aae83a-2f72-4cca-b514-ec44eda0335c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:25.867761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-05aae83a-2f72-4cca-b514-ec44eda0335c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.171123 Jul 28 09:16:25.868520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 274/531] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:25 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:25.996227 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:26.004770 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:26.006373 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:26.007511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e096c931-f400-4345-ae38-df7469386c53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.162875 Jul 28 09:16:26.008068 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 258/532] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:25 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:26.698900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-be209217-07f8-4ca2-a551-52a31c493142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:26.699396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-be209217-07f8-4ca2-a551-52a31c493142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:26.706536 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be209217-07f8-4ca2-a551-52a31c493142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:26.707086 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be209217-07f8-4ca2-a551-52a31c493142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:26.707753 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be209217-07f8-4ca2-a551-52a31c493142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:26.708183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be209217-07f8-4ca2-a551-52a31c493142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:26.712273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:26.733986 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-be209217-07f8-4ca2-a551-52a31c493142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/ips" status: 200 len: 150 microversion: 2.1 time: 0.038861 Jul 28 09:16:26.734556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 275/533] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:16:26 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:26.892489 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bda26d9f-aeaf-4820-bf20-d9a157933294 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:26.893742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bda26d9f-aeaf-4820-bf20-d9a157933294 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:26.901202 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bda26d9f-aeaf-4820-bf20-d9a157933294 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:26.901740 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bda26d9f-aeaf-4820-bf20-d9a157933294 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:26.902589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bda26d9f-aeaf-4820-bf20-d9a157933294 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:26.903095 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bda26d9f-aeaf-4820-bf20-d9a157933294 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:27.032308 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:27.032917 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:27.035923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=27 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:27.040791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bda26d9f-aeaf-4820-bf20-d9a157933294 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:27.046279 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:27.050480 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:27.051016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:27.051905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:27.052532 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:27.065914 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bda26d9f-aeaf-4820-bf20-d9a157933294 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.178628 Jul 28 09:16:27.066618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 259/534] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:26 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:27.198588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:27.207469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:27.208902 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:27.210090 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b900316a-9360-4624-8942-8fd0f7a25f00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.182520 Jul 28 09:16:27.210643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 276/535] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:27 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:28.088334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dce46836-fa5f-4c8b-8022-aedb71d849af tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:28.088997 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dce46836-fa5f-4c8b-8022-aedb71d849af tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:28.096124 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dce46836-fa5f-4c8b-8022-aedb71d849af tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:28.096588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dce46836-fa5f-4c8b-8022-aedb71d849af tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:28.097914 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dce46836-fa5f-4c8b-8022-aedb71d849af tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:28.098539 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dce46836-fa5f-4c8b-8022-aedb71d849af tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:28.235254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:28.237392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:28.243149 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dce46836-fa5f-4c8b-8022-aedb71d849af tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:28.253548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:28.253997 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dce46836-fa5f-4c8b-8022-aedb71d849af tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.169244 Jul 28 09:16:28.254662 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:28.255120 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 260/536] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:28 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:28.256747 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:28.257503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:28.311098 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6d66714c-77c8-44eb-ace8-3cb6270714b4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c3072c9-0124-4063-a7e3-83d86bd805d8"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:28.314541 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6d66714c-77c8-44eb-ace8-3cb6270714b4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:28.321178 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d66714c-77c8-44eb-ace8-3cb6270714b4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:28.321671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d66714c-77c8-44eb-ace8-3cb6270714b4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:28.322450 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d66714c-77c8-44eb-ace8-3cb6270714b4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:28.322973 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d66714c-77c8-44eb-ace8-3cb6270714b4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:28.418091 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:28.427174 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:28.428656 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:28.430020 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b534b8d8-0025-4894-a090-c5c198e0a3c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.201487 Jul 28 09:16:28.430570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 277/537] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:28 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:28.464777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:16:28.465027 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Thu Jul 28 09:16:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:16:28.634616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6d66714c-77c8-44eb-ace8-3cb6270714b4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328176 Jul 28 09:16:28.635251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 261/538] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:16:28 2022] POST /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:16:29.276732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-59e4cae9-6b7c-414b-96a8-54fdae6bd30b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:29.277436 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-59e4cae9-6b7c-414b-96a8-54fdae6bd30b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:29.284127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59e4cae9-6b7c-414b-96a8-54fdae6bd30b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:29.284574 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59e4cae9-6b7c-414b-96a8-54fdae6bd30b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:29.285338 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59e4cae9-6b7c-414b-96a8-54fdae6bd30b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:29.285772 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59e4cae9-6b7c-414b-96a8-54fdae6bd30b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:29.434385 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-59e4cae9-6b7c-414b-96a8-54fdae6bd30b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:29.442867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-59e4cae9-6b7c-414b-96a8-54fdae6bd30b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.170466 Jul 28 09:16:29.443423 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 278/539] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:29 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:29.456539 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:29.457523 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:29.459589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:29.465350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:29.465793 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:29.466579 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:29.467036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:29.698978 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:29.708328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:29.710304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:29.713251 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-34c0e677-0f6a-45d0-92ba-f7d9a0822f2a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.261580 Jul 28 09:16:29.714223 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 262/540] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:29 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:30.465975 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-751fe877-09d8-41d4-9c97-6fc01430764e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:30.466589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-751fe877-09d8-41d4-9c97-6fc01430764e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:30.474037 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-751fe877-09d8-41d4-9c97-6fc01430764e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:30.474484 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-751fe877-09d8-41d4-9c97-6fc01430764e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:30.475754 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-751fe877-09d8-41d4-9c97-6fc01430764e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:30.475754 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-751fe877-09d8-41d4-9c97-6fc01430764e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:30.697059 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-751fe877-09d8-41d4-9c97-6fc01430764e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:30.705982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-751fe877-09d8-41d4-9c97-6fc01430764e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.243915 Jul 28 09:16:30.706553 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 279/541] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:30 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:16:30.736535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:30.737107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:30.743667 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:30.744100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:30.744847 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:30.745276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:30.886005 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:30.894718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:30.896249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:30.897410 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d5c19aa2-edbf-4146-b534-829fc7c43b76 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.164805 Jul 28 09:16:30.897992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 263/542] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:30 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:31.728893 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ea156b6b-4774-446b-a63c-468f21cda718 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:31.729592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ea156b6b-4774-446b-a63c-468f21cda718 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:31.737083 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ea156b6b-4774-446b-a63c-468f21cda718 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:31.737723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ea156b6b-4774-446b-a63c-468f21cda718 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:31.738699 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ea156b6b-4774-446b-a63c-468f21cda718 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:31.739213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ea156b6b-4774-446b-a63c-468f21cda718 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:31.868489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ea156b6b-4774-446b-a63c-468f21cda718 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:31.876604 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ea156b6b-4774-446b-a63c-468f21cda718 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.151958 Jul 28 09:16:31.877221 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 280/543] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:31 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:31.920395 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:31.921172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:31.930863 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:31.931220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:31.931993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:31.932431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:32.063361 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:32.071315 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:32.072915 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:32.074071 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8601ec7c-77d1-4bde-9878-2aacbe46d8cb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.157877 Jul 28 09:16:32.074622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 264/544] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:31 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:32.898925 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e4306e8a-a8fb-430c-8226-6eb044d9a12e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:32.899542 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e4306e8a-a8fb-430c-8226-6eb044d9a12e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:32.906634 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e4306e8a-a8fb-430c-8226-6eb044d9a12e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:32.907100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e4306e8a-a8fb-430c-8226-6eb044d9a12e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:32.907865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e4306e8a-a8fb-430c-8226-6eb044d9a12e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:32.908305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e4306e8a-a8fb-430c-8226-6eb044d9a12e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:33.037385 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e4306e8a-a8fb-430c-8226-6eb044d9a12e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:33.045193 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e4306e8a-a8fb-430c-8226-6eb044d9a12e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.150196 Jul 28 09:16:33.045750 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 281/545] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:32 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:16:33.096829 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:33.097431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:33.103860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:33.104304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:33.105052 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:33.105484 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:33.239513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:33.247757 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:33.249266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:33.251050 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d051f47e-8583-4c11-8311-6a6936210304 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.158085 Jul 28 09:16:33.251607 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 265/546] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:33 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:34.067029 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bb1b9139-00dc-4975-9f98-0bf3093cd851 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:34.067760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bb1b9139-00dc-4975-9f98-0bf3093cd851 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:34.073585 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb1b9139-00dc-4975-9f98-0bf3093cd851 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:34.074191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb1b9139-00dc-4975-9f98-0bf3093cd851 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:34.074954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb1b9139-00dc-4975-9f98-0bf3093cd851 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:34.075446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb1b9139-00dc-4975-9f98-0bf3093cd851 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:34.213091 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-bb1b9139-00dc-4975-9f98-0bf3093cd851 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:34.222842 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bb1b9139-00dc-4975-9f98-0bf3093cd851 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.160041 Jul 28 09:16:34.223491 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 282/547] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:34 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:34.276436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:34.277058 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:34.284594 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:34.285027 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:34.285805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:34.286278 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:34.532268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:34.540129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:34.541616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:34.542804 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-eebb986d-b8e5-42ca-aae8-a99435e0d8e0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.271084 Jul 28 09:16:34.543353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 266/548] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:34 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:35.246314 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-58a351f3-c307-4a49-b81e-c16794f1c6e7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:35.247151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-58a351f3-c307-4a49-b81e-c16794f1c6e7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:35.257309 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58a351f3-c307-4a49-b81e-c16794f1c6e7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:35.257772 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58a351f3-c307-4a49-b81e-c16794f1c6e7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:35.258665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58a351f3-c307-4a49-b81e-c16794f1c6e7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:35.259106 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58a351f3-c307-4a49-b81e-c16794f1c6e7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:35.405278 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-58a351f3-c307-4a49-b81e-c16794f1c6e7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:35.413608 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-58a351f3-c307-4a49-b81e-c16794f1c6e7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.172913 Jul 28 09:16:35.414265 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 283/549] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:35 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:35.566349 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:35.566944 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:35.573334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:35.573775 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:35.574548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:35.574979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:35.714163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:35.723204 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:35.724701 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:35.725875 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5e7b048e-69f0-4751-86d5-78eee13f6522 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.163353 Jul 28 09:16:35.726872 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 267/550] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:35 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:36.175626 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-13177be3-18f3-4e4b-a91c-23d74bf61966 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: .version_select at 0x7fd6beeff160>, body: {"keypair": {"name": "tempest-keypair-864685185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeUVqeuZVBxTbbBYXVfvFA5NgIZCLYY6+woOEeChotw/Kk0vTGFsTOHYSJFxMR1UknF6OXfUg8sc0heDn+O/C2vibI3fiVBBBYIE9fFaTv7xgkMO5pn0EBGuJp8v4dRKg=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:36.190887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-13177be3-18f3-4e4b-a91c-23d74bf61966 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for project c957cfe3391147daab9fc1e59b414a3e. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:16:36.194570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-13177be3-18f3-4e4b-a91c-23d74bf61966 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for user e0c1ed47784c46baa7ddc4abdfc54bbb and project c957cfe3391147daab9fc1e59b414a3e. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:16:36.220026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-13177be3-18f3-4e4b-a91c-23d74bf61966 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048295 Jul 28 09:16:36.220610 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 284/551] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:16:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:36.435442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-66a5d872-f4e1-4bb5-8156-51a461b6383e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:36.435960 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-66a5d872-f4e1-4bb5-8156-51a461b6383e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:36.442950 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-66a5d872-f4e1-4bb5-8156-51a461b6383e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:36.443545 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-66a5d872-f4e1-4bb5-8156-51a461b6383e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:36.444385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-66a5d872-f4e1-4bb5-8156-51a461b6383e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:36.444816 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-66a5d872-f4e1-4bb5-8156-51a461b6383e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:36.628944 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-66a5d872-f4e1-4bb5-8156-51a461b6383e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:36.637720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-66a5d872-f4e1-4bb5-8156-51a461b6383e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.206177 Jul 28 09:16:36.638608 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 268/552] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:36 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:36.749095 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:36.750499 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:36.756565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:36.757151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:36.758018 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:36.758456 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:36.974203 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:36.982359 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:36.983902 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:36.985714 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e2132940-e5e6-4dba-9410-48a1108ccf60 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.241076 Jul 28 09:16:36.986502 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 285/553] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:36 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:37.637427 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1417744085", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a25c70eb-0093-412d-853c-bc88149a664e"}], "security_groups": [{"name": "tempest-securitygroup--1246294174"}], "key_name": "tempest-keypair-864685185", "user_data": "}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:37.659485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-978e8494-fbf6-4cba-bc9f-83b3abb86d31 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:37.660096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-978e8494-fbf6-4cba-bc9f-83b3abb86d31 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:37.666276 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-978e8494-fbf6-4cba-bc9f-83b3abb86d31 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:37.666755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-978e8494-fbf6-4cba-bc9f-83b3abb86d31 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:37.667520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-978e8494-fbf6-4cba-bc9f-83b3abb86d31 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:37.667957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-978e8494-fbf6-4cba-bc9f-83b3abb86d31 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:37.783206 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] validate_networks() for [('a25c70eb-0093-412d-853c-bc88149a664e', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:16:37.884881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-978e8494-fbf6-4cba-bc9f-83b3abb86d31 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:37.893362 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-978e8494-fbf6-4cba-bc9f-83b3abb86d31 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.238138 Jul 28 09:16:37.894034 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 286/554] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:37 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:16:38.008354 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:38.009040 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:38.014813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:38.015810 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:38.016524 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:38.016957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:38.208448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:38.216593 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:38.218229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:38.220161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-15962703-d6e6-4c34-8328-7d6317f67473 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.215605 Jul 28 09:16:38.220791 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 287/555] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:38 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:38.310105 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:16:38.310532 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:16:38.311006 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:16:38.311418 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:16:38.311832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:16:38.321140 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:38.321588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:38.322445 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:38.322884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:38.340441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for project c957cfe3391147daab9fc1e59b414a3e. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:16:38.344361 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for user e0c1ed47784c46baa7ddc4abdfc54bbb and project c957cfe3391147daab9fc1e59b414a3e. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:16:38.355199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:16:38.357417 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:16:38.403229 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5e440efd-4144-4239-93d0-418939d3ee0c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.770214 Jul 28 09:16:38.408221 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 269/556] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:16:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:16:38.414552 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8cb146ec-1dcf-4fb4-bf3d-4e36c6a82576 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:38.415172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8cb146ec-1dcf-4fb4-bf3d-4e36c6a82576 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:38.471193 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8cb146ec-1dcf-4fb4-bf3d-4e36c6a82576 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:38.477932 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8cb146ec-1dcf-4fb4-bf3d-4e36c6a82576 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1241 microversion: 2.1 time: 0.067098 Jul 28 09:16:38.478796 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 288/557] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:38 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:38.915905 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-236fbb6a-e13d-466a-94f5-52321dddd409 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:38.916517 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-236fbb6a-e13d-466a-94f5-52321dddd409 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:38.924318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-236fbb6a-e13d-466a-94f5-52321dddd409 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:38.924318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-236fbb6a-e13d-466a-94f5-52321dddd409 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:38.924898 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-236fbb6a-e13d-466a-94f5-52321dddd409 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:38.925364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-236fbb6a-e13d-466a-94f5-52321dddd409 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:39.056004 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-236fbb6a-e13d-466a-94f5-52321dddd409 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:39.064301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-236fbb6a-e13d-466a-94f5-52321dddd409 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.152838 Jul 28 09:16:39.064869 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 270/558] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:38 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:39.242802 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:39.243391 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:39.250117 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:39.250567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:39.251405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:39.251834 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:39.380460 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:39.395027 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:39.396522 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:39.397688 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0edf52e4-ed24-4827-9ea4-9deb2ef1f0cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.158883 Jul 28 09:16:39.398275 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 289/559] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:39 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:39.498025 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b558f7fa-6481-4f08-83ca-321fa42e44b0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:39.498562 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b558f7fa-6481-4f08-83ca-321fa42e44b0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:39.504616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b558f7fa-6481-4f08-83ca-321fa42e44b0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:39.505058 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b558f7fa-6481-4f08-83ca-321fa42e44b0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:39.505869 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b558f7fa-6481-4f08-83ca-321fa42e44b0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:39.506302 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b558f7fa-6481-4f08-83ca-321fa42e44b0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:39.567561 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b558f7fa-6481-4f08-83ca-321fa42e44b0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:39.574814 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b558f7fa-6481-4f08-83ca-321fa42e44b0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1293 microversion: 2.1 time: 0.080785 Jul 28 09:16:39.575404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 271/560] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:39 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:40.085228 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3e9d50d0-2083-46a3-9019-0495ce646016 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:40.086043 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3e9d50d0-2083-46a3-9019-0495ce646016 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:40.092393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e9d50d0-2083-46a3-9019-0495ce646016 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:40.092893 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e9d50d0-2083-46a3-9019-0495ce646016 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:40.093794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e9d50d0-2083-46a3-9019-0495ce646016 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:40.094279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e9d50d0-2083-46a3-9019-0495ce646016 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:40.321364 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3e9d50d0-2083-46a3-9019-0495ce646016 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:40.329704 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3e9d50d0-2083-46a3-9019-0495ce646016 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1724 microversion: 2.1 time: 0.248500 Jul 28 09:16:40.330298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 290/561] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:40 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:40.421052 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:40.422217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:40.428547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:40.428988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:40.429728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:40.430276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:40.597412 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f9e4431f-7d06-4b10-962a-a33e57785fd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:40.598059 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f9e4431f-7d06-4b10-962a-a33e57785fd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:40.604005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9e4431f-7d06-4b10-962a-a33e57785fd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:40.604451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9e4431f-7d06-4b10-962a-a33e57785fd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:40.605214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9e4431f-7d06-4b10-962a-a33e57785fd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:40.605651 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9e4431f-7d06-4b10-962a-a33e57785fd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:40.867776 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:40.876367 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:40.877902 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:40.879069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1ac9afcf-0467-4da2-94df-e9d644cf7eef tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1743 microversion: 2.20 time: 0.461908 Jul 28 09:16:40.879631 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 272/562] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:40 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1743 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:40.897667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f9e4431f-7d06-4b10-962a-a33e57785fd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:40.905195 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f9e4431f-7d06-4b10-962a-a33e57785fd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1299 microversion: 2.1 time: 0.312530 Jul 28 09:16:40.907973 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 291/563] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:40 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1299 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:16:41.351594 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-39454c9e-ed29-4ee7-ad4f-5b01804b3008 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:41.352207 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-39454c9e-ed29-4ee7-ad4f-5b01804b3008 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:41.358979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39454c9e-ed29-4ee7-ad4f-5b01804b3008 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:41.359950 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39454c9e-ed29-4ee7-ad4f-5b01804b3008 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:41.360722 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39454c9e-ed29-4ee7-ad4f-5b01804b3008 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:41.361479 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39454c9e-ed29-4ee7-ad4f-5b01804b3008 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:41.506667 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-39454c9e-ed29-4ee7-ad4f-5b01804b3008 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:41.517184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-39454c9e-ed29-4ee7-ad4f-5b01804b3008 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1701 microversion: 2.1 time: 0.169911 Jul 28 09:16:41.517689 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 273/564] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:41 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:41.537903 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-160cb35e-ec71-4442-b2ea-09b4606312b5 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:41.544714 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-160cb35e-ec71-4442-b2ea-09b4606312b5 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:41.545158 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-160cb35e-ec71-4442-b2ea-09b4606312b5 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:41.605819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-160cb35e-ec71-4442-b2ea-09b4606312b5 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Going to try to start instance {{(pid=117864) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 09:16:41.648929 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-160cb35e-ec71-4442-b2ea-09b4606312b5 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/action" status: 202 len: 0 microversion: 2.1 time: 0.114667 Jul 28 09:16:41.649526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 292/565] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:16:41 2022] POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:16:41.658022 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-303f3a9e-aa4d-43ee-9106-fc934fde68b6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:41.658629 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-303f3a9e-aa4d-43ee-9106-fc934fde68b6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:41.665089 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-303f3a9e-aa4d-43ee-9106-fc934fde68b6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:41.665569 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-303f3a9e-aa4d-43ee-9106-fc934fde68b6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:41.666739 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-303f3a9e-aa4d-43ee-9106-fc934fde68b6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:41.667110 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-303f3a9e-aa4d-43ee-9106-fc934fde68b6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:41.902994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:41.903720 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:41.911062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:41.911516 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:41.912293 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:41.912730 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:41.916973 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:41.977577 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-303f3a9e-aa4d-43ee-9106-fc934fde68b6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:41.987149 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-303f3a9e-aa4d-43ee-9106-fc934fde68b6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1710 microversion: 2.1 time: 0.333290 Jul 28 09:16:41.987809 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 274/566] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:41 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1710 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:41.993654 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-466bb264-a05b-496c-8999-cb7b5f640c0b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:41.994608 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-466bb264-a05b-496c-8999-cb7b5f640c0b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:42.005227 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-466bb264-a05b-496c-8999-cb7b5f640c0b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:42.005678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-466bb264-a05b-496c-8999-cb7b5f640c0b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:42.006644 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-466bb264-a05b-496c-8999-cb7b5f640c0b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:42.007241 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-466bb264-a05b-496c-8999-cb7b5f640c0b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:42.288890 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:42.299248 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:42.301075 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:42.303198 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f49df15c-be2f-41a0-99e2-fb219d58e908 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1743 microversion: 2.20 time: 0.404469 Jul 28 09:16:42.304298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 293/567] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:41 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1743 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:42.355393 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-466bb264-a05b-496c-8999-cb7b5f640c0b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:42.365080 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:42.370124 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-466bb264-a05b-496c-8999-cb7b5f640c0b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.380302 Jul 28 09:16:42.371006 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 275/568] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:41 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:42.769080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-af0f9470-3820-4bf2-9081-8d9e6ca6f791 req-33bb4d2a-c221-403d-8cf7-d09ddd6e2fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886e113b-47d9-4760-bf0d-d5a2901b61f3", "tag": "5f846baf-d511-4258-bded-99970e48af03"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:42.782317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-af0f9470-3820-4bf2-9081-8d9e6ca6f791 req-33bb4d2a-c221-403d-8cf7-d09ddd6e2fd0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:42.783067 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-af0f9470-3820-4bf2-9081-8d9e6ca6f791 req-33bb4d2a-c221-403d-8cf7-d09ddd6e2fd0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:42.807273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-af0f9470-3820-4bf2-9081-8d9e6ca6f791 req-33bb4d2a-c221-403d-8cf7-d09ddd6e2fd0 service nova] Creating event network-changed:5f846baf-d511-4258-bded-99970e48af03 for instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 on hv-cinder-85124 Jul 28 09:16:42.813054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-af0f9470-3820-4bf2-9081-8d9e6ca6f791 req-33bb4d2a-c221-403d-8cf7-d09ddd6e2fd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048478 Jul 28 09:16:42.814649 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 294/569] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:16:43.008414 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-230e5ff0-776b-45e8-b4fb-5a5aa100c530 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:43.008947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-230e5ff0-776b-45e8-b4fb-5a5aa100c530 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:43.016315 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-230e5ff0-776b-45e8-b4fb-5a5aa100c530 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:43.016752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-230e5ff0-776b-45e8-b4fb-5a5aa100c530 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:43.017495 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-230e5ff0-776b-45e8-b4fb-5a5aa100c530 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:43.017949 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-230e5ff0-776b-45e8-b4fb-5a5aa100c530 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:43.177962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-230e5ff0-776b-45e8-b4fb-5a5aa100c530 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:43.185781 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-230e5ff0-776b-45e8-b4fb-5a5aa100c530 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1710 microversion: 2.1 time: 0.181229 Jul 28 09:16:43.186380 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 276/570] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:43 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1710 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:43.328206 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:43.328901 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:43.334995 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:43.335443 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:43.336210 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:43.336649 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:43.392253 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-be1c3ad4-3a9e-41df-982c-cd70e35428fa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:43.392858 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-be1c3ad4-3a9e-41df-982c-cd70e35428fa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:43.398777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be1c3ad4-3a9e-41df-982c-cd70e35428fa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:43.399222 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be1c3ad4-3a9e-41df-982c-cd70e35428fa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:43.399973 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be1c3ad4-3a9e-41df-982c-cd70e35428fa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:43.400403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be1c3ad4-3a9e-41df-982c-cd70e35428fa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:43.592524 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:43.600439 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:43.601979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:43.603141 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e2e0bc5a-5aba-47c8-8714-182bd97aa81e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1743 microversion: 2.20 time: 0.279870 Jul 28 09:16:43.603713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 295/571] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:43 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1743 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:43.622175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-be1c3ad4-3a9e-41df-982c-cd70e35428fa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:43.630038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-be1c3ad4-3a9e-41df-982c-cd70e35428fa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.242133 Jul 28 09:16:43.630598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 277/572] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:43 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:16:44.073812 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-03ebe9a2-3cff-4a18-b009-5594eb34361e req-17b95fe8-7e04-4371-ae8a-99c013c94cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145d502e-eb34-435a-8b8c-2ea6264d1506", "name": "network-vif-plugged", "status": "completed", "tag": "51927101-a0e7-4577-83b1-566bb606eeb1"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:44.084586 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-03ebe9a2-3cff-4a18-b009-5594eb34361e req-17b95fe8-7e04-4371-ae8a-99c013c94cf4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:44.085073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-03ebe9a2-3cff-4a18-b009-5594eb34361e req-17b95fe8-7e04-4371-ae8a-99c013c94cf4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:44.096271 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-03ebe9a2-3cff-4a18-b009-5594eb34361e req-17b95fe8-7e04-4371-ae8a-99c013c94cf4 service nova] Creating event network-vif-plugged:51927101-a0e7-4577-83b1-566bb606eeb1 for instance 145d502e-eb34-435a-8b8c-2ea6264d1506 on hv-cinder-85124 Jul 28 09:16:44.100929 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-03ebe9a2-3cff-4a18-b009-5594eb34361e req-17b95fe8-7e04-4371-ae8a-99c013c94cf4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 Jul 28 09:16:44.101511 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 296/573] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:44.207900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d2c0d0a0-8fec-4203-898b-408c1967bd21 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:44.208508 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d2c0d0a0-8fec-4203-898b-408c1967bd21 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:44.215692 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0a0-8fec-4203-898b-408c1967bd21 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:44.216143 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0a0-8fec-4203-898b-408c1967bd21 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:44.216904 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0a0-8fec-4203-898b-408c1967bd21 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:44.217348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0a0-8fec-4203-898b-408c1967bd21 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:44.349694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d2c0d0a0-8fec-4203-898b-408c1967bd21 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:44.357570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d2c0d0a0-8fec-4203-898b-408c1967bd21 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1710 microversion: 2.1 time: 0.153780 Jul 28 09:16:44.358172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 278/574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:44 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:44.627927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:44.628538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:44.634788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:44.635233 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:44.635980 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:44.636410 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:44.651194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-86ffe032-48c4-473a-9903-0dbdc1372493 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:44.651890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-86ffe032-48c4-473a-9903-0dbdc1372493 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:44.657740 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-86ffe032-48c4-473a-9903-0dbdc1372493 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:44.658230 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-86ffe032-48c4-473a-9903-0dbdc1372493 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:44.658977 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-86ffe032-48c4-473a-9903-0dbdc1372493 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:44.659564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-86ffe032-48c4-473a-9903-0dbdc1372493 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:44.836771 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:44.840730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-86ffe032-48c4-473a-9903-0dbdc1372493 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:44.844781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:44.846304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:44.847444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a2437032-6a71-4f22-9f00-11a0e844693a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1743 microversion: 2.20 time: 0.224445 Jul 28 09:16:44.848000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 297/575] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:44 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:44.848177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-86ffe032-48c4-473a-9903-0dbdc1372493 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.200758 Jul 28 09:16:44.848724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 279/576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:44 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:16:45.379347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6967cb3f-7cc3-4025-81fc-c545f4f06b17 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:45.379962 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6967cb3f-7cc3-4025-81fc-c545f4f06b17 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:45.386111 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6967cb3f-7cc3-4025-81fc-c545f4f06b17 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:45.386563 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6967cb3f-7cc3-4025-81fc-c545f4f06b17 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:45.387322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6967cb3f-7cc3-4025-81fc-c545f4f06b17 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:45.387762 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6967cb3f-7cc3-4025-81fc-c545f4f06b17 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:45.515181 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6967cb3f-7cc3-4025-81fc-c545f4f06b17 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:45.523552 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6967cb3f-7cc3-4025-81fc-c545f4f06b17 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1710 microversion: 2.1 time: 0.148058 Jul 28 09:16:45.524116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 298/577] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:45 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1710 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:45.868944 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d7508042-58bb-4cfb-8a9e-2f8254cf849e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:45.869505 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d7508042-58bb-4cfb-8a9e-2f8254cf849e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:45.870291 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:45.870897 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:45.876766 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d7508042-58bb-4cfb-8a9e-2f8254cf849e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:45.877212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d7508042-58bb-4cfb-8a9e-2f8254cf849e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:45.877677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:45.878023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d7508042-58bb-4cfb-8a9e-2f8254cf849e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:45.878135 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:45.878468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d7508042-58bb-4cfb-8a9e-2f8254cf849e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:45.878901 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:45.879389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:46.073038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:46.076973 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d7508042-58bb-4cfb-8a9e-2f8254cf849e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:46.085567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:46.086784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d7508042-58bb-4cfb-8a9e-2f8254cf849e tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.221666 Jul 28 09:16:46.087092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:46.087364 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 280/578] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:45 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:46.088242 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ecf5d18a-156c-49b5-a820-720ba2926644 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1743 microversion: 2.20 time: 0.221688 Jul 28 09:16:46.088777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 299/579] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:45 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1743 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:46.545150 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ea79d8bb-6e6f-4bba-85e6-914b05ad8d77 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:46.545751 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ea79d8bb-6e6f-4bba-85e6-914b05ad8d77 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:46.552534 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ea79d8bb-6e6f-4bba-85e6-914b05ad8d77 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:46.552972 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ea79d8bb-6e6f-4bba-85e6-914b05ad8d77 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:46.553721 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ea79d8bb-6e6f-4bba-85e6-914b05ad8d77 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:46.554178 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ea79d8bb-6e6f-4bba-85e6-914b05ad8d77 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:46.682459 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ea79d8bb-6e6f-4bba-85e6-914b05ad8d77 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:46.690293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ea79d8bb-6e6f-4bba-85e6-914b05ad8d77 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1710 microversion: 2.1 time: 0.148929 Jul 28 09:16:46.690857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 281/580] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:46 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:47.113322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:47.114013 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:47.115479 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d8c8ee23-c8ce-4e25-a8da-4ca778b7a523 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:47.116087 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d8c8ee23-c8ce-4e25-a8da-4ca778b7a523 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:47.120514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:47.120959 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:47.121709 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:47.122171 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:47.122468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d8c8ee23-c8ce-4e25-a8da-4ca778b7a523 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:47.122920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d8c8ee23-c8ce-4e25-a8da-4ca778b7a523 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:47.123678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d8c8ee23-c8ce-4e25-a8da-4ca778b7a523 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:47.124112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d8c8ee23-c8ce-4e25-a8da-4ca778b7a523 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:47.317771 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:47.320878 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d8c8ee23-c8ce-4e25-a8da-4ca778b7a523 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:47.325771 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:47.327640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:47.328537 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d8c8ee23-c8ce-4e25-a8da-4ca778b7a523 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.217403 Jul 28 09:16:47.329530 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-deecb516-5f25-4623-9a76-78801b12bf00 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1743 microversion: 2.20 time: 0.219679 Jul 28 09:16:47.329637 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 282/581] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:47 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:16:47.330106 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 300/582] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:47 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:47.712082 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-979b97ce-56fc-4da9-a3b5-5032603412cf tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:47.713910 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-979b97ce-56fc-4da9-a3b5-5032603412cf tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:47.719863 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-979b97ce-56fc-4da9-a3b5-5032603412cf tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:47.720305 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-979b97ce-56fc-4da9-a3b5-5032603412cf tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:47.721085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-979b97ce-56fc-4da9-a3b5-5032603412cf tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:47.721510 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-979b97ce-56fc-4da9-a3b5-5032603412cf tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:47.854687 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-979b97ce-56fc-4da9-a3b5-5032603412cf tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:47.863129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-979b97ce-56fc-4da9-a3b5-5032603412cf tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1714 microversion: 2.1 time: 0.155348 Jul 28 09:16:47.863690 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 283/583] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:47 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:48.350459 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e58bd46b-f06f-4e70-a599-4d24050858c9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:48.351157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e58bd46b-f06f-4e70-a599-4d24050858c9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:48.351396 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:48.352007 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:48.354969 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:48.355257 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=6 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:48.359284 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e58bd46b-f06f-4e70-a599-4d24050858c9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:48.359723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e58bd46b-f06f-4e70-a599-4d24050858c9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:48.360732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e58bd46b-f06f-4e70-a599-4d24050858c9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:48.361065 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:48.361384 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e58bd46b-f06f-4e70-a599-4d24050858c9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:48.361551 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:48.362315 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:48.362754 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:48.475648 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:48.753540 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:48.756519 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e58bd46b-f06f-4e70-a599-4d24050858c9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:48.761672 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:48.763204 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:48.763837 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e58bd46b-f06f-4e70-a599-4d24050858c9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.417242 Jul 28 09:16:48.764379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2c490198-d251-4656-9584-d225fac9af83 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1743 microversion: 2.20 time: 0.416801 Jul 28 09:16:48.764517 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 301/584] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:48 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:48.764915 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 284/585] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:48 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1743 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:49.785606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b58bcab9-b71b-4914-9b00-b7eda3286be7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:49.786486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b58bcab9-b71b-4914-9b00-b7eda3286be7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:49.786725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:49.787343 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:49.793794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b58bcab9-b71b-4914-9b00-b7eda3286be7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:49.794009 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:49.794487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:49.794954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b58bcab9-b71b-4914-9b00-b7eda3286be7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:49.795270 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:49.795710 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:49.796574 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b58bcab9-b71b-4914-9b00-b7eda3286be7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:49.797269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b58bcab9-b71b-4914-9b00-b7eda3286be7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:50.033323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b58bcab9-b71b-4914-9b00-b7eda3286be7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:50.043279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b58bcab9-b71b-4914-9b00-b7eda3286be7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.262536 Jul 28 09:16:50.045678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:50.046581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 302/586] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:49 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:50.054954 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:50.056478 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:50.057650 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9f485bbf-deac-4fcb-b264-bfb3ee112684 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1738 microversion: 2.20 time: 0.275258 Jul 28 09:16:50.058230 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 285/587] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:49 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:51.071431 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-07e3e50d-367c-46d7-8acd-521d5d1e98d8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:51.073029 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-07e3e50d-367c-46d7-8acd-521d5d1e98d8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:51.085586 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07e3e50d-367c-46d7-8acd-521d5d1e98d8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:51.087790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:51.089038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:51.092253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07e3e50d-367c-46d7-8acd-521d5d1e98d8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:51.096511 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07e3e50d-367c-46d7-8acd-521d5d1e98d8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:51.097283 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07e3e50d-367c-46d7-8acd-521d5d1e98d8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:51.101537 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:51.102036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:51.102827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:51.103298 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:51.330269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-07e3e50d-367c-46d7-8acd-521d5d1e98d8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:51.342982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-07e3e50d-367c-46d7-8acd-521d5d1e98d8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.278052 Jul 28 09:16:51.343876 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 303/588] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:51 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:51.344068 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:51.353160 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:51.355249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:51.356822 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d38db88d-dd31-434e-8afc-e4868dac3172 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1738 microversion: 2.20 time: 0.275232 Jul 28 09:16:51.369881 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 286/589] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:51 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:52.066430 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-6a46ef41-6ffb-4be8-8c7f-1eb6d39e0618 req-ffdeaef4-f5d6-4889-a8fd-cc1687f1a71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886e113b-47d9-4760-bf0d-d5a2901b61f3", "name": "network-vif-plugged", "status": "completed", "tag": "5f846baf-d511-4258-bded-99970e48af03"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:52.078344 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-6a46ef41-6ffb-4be8-8c7f-1eb6d39e0618 req-ffdeaef4-f5d6-4889-a8fd-cc1687f1a71d service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:52.079619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-6a46ef41-6ffb-4be8-8c7f-1eb6d39e0618 req-ffdeaef4-f5d6-4889-a8fd-cc1687f1a71d service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:52.096256 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-6a46ef41-6ffb-4be8-8c7f-1eb6d39e0618 req-ffdeaef4-f5d6-4889-a8fd-cc1687f1a71d service nova] Creating event network-vif-plugged:5f846baf-d511-4258-bded-99970e48af03 for instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 on hv-cinder-85124 Jul 28 09:16:52.101691 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-6a46ef41-6ffb-4be8-8c7f-1eb6d39e0618 req-ffdeaef4-f5d6-4889-a8fd-cc1687f1a71d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040901 Jul 28 09:16:52.102336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 304/590] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:52.365359 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-96e8e5f9-7122-4f25-a1d5-7ec43d800615 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:52.366650 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-96e8e5f9-7122-4f25-a1d5-7ec43d800615 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:52.373767 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-96e8e5f9-7122-4f25-a1d5-7ec43d800615 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:52.374294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-96e8e5f9-7122-4f25-a1d5-7ec43d800615 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:52.375587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-96e8e5f9-7122-4f25-a1d5-7ec43d800615 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:52.376268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-96e8e5f9-7122-4f25-a1d5-7ec43d800615 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:52.382854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:52.383552 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:52.392835 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:52.393288 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:52.394094 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:52.394538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:52.619304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-96e8e5f9-7122-4f25-a1d5-7ec43d800615 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:52.627793 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-96e8e5f9-7122-4f25-a1d5-7ec43d800615 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.266397 Jul 28 09:16:52.629083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 287/591] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:52 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:52.657933 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:52.666840 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:52.668368 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:52.669533 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2d4645e6-71d5-48c8-bce2-331f9ac173f6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1738 microversion: 2.20 time: 0.292010 Jul 28 09:16:52.670128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 305/592] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:52 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:53.648666 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7ff9eba2-37ac-43ff-8fde-015227e9e46f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:53.650403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7ff9eba2-37ac-43ff-8fde-015227e9e46f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:53.658295 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ff9eba2-37ac-43ff-8fde-015227e9e46f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:53.658991 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ff9eba2-37ac-43ff-8fde-015227e9e46f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:53.660083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ff9eba2-37ac-43ff-8fde-015227e9e46f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:53.660552 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7ff9eba2-37ac-43ff-8fde-015227e9e46f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:53.693736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:53.694370 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:53.704378 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:53.705227 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:53.706214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:53.706802 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:53.915098 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7ff9eba2-37ac-43ff-8fde-015227e9e46f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:53.915497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:53.925091 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7ff9eba2-37ac-43ff-8fde-015227e9e46f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1367 microversion: 2.1 time: 0.280159 Jul 28 09:16:53.936435 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:53.938541 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:53.939711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-11b9fa00-c0db-45f1-9268-160989caa6d6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1738 microversion: 2.20 time: 0.249957 Jul 28 09:16:53.941650 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 288/593] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:53 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:53.956560 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 306/594] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:53 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:16:54.948196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c3dbc3b8-b6a0-44c1-b01c-f07e75d76297 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:54.948812 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c3dbc3b8-b6a0-44c1-b01c-f07e75d76297 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:54.958430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c3dbc3b8-b6a0-44c1-b01c-f07e75d76297 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:54.958430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c3dbc3b8-b6a0-44c1-b01c-f07e75d76297 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:54.958430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c3dbc3b8-b6a0-44c1-b01c-f07e75d76297 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:54.963603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:54.964858 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:54.968446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c3dbc3b8-b6a0-44c1-b01c-f07e75d76297 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:54.976198 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:54.976928 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:54.978867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:54.979504 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:55.201000 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c3dbc3b8-b6a0-44c1-b01c-f07e75d76297 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:55.209863 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c3dbc3b8-b6a0-44c1-b01c-f07e75d76297 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1558 microversion: 2.1 time: 0.265542 Jul 28 09:16:55.210449 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 289/595] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:16:54 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1558 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:16:55.226461 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:55.230245 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-569a15b2-e676-4d34-82db-c55d8e0f27a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:55.231213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-569a15b2-e676-4d34-82db-c55d8e0f27a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:55.236001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:55.237976 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:55.238158 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-569a15b2-e676-4d34-82db-c55d8e0f27a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:55.238717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-569a15b2-e676-4d34-82db-c55d8e0f27a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:55.239491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-569a15b2-e676-4d34-82db-c55d8e0f27a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:55.240127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c3fc0cc7-40f0-4c4f-a41a-364f2276a44b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1738 microversion: 2.20 time: 0.280107 Jul 28 09:16:55.240574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-569a15b2-e676-4d34-82db-c55d8e0f27a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:55.254763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 307/596] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:54 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:55.337782 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-569a15b2-e676-4d34-82db-c55d8e0f27a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111526 Jul 28 09:16:55.339353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 290/597] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 09:16:55 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:56.264700 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:56.265247 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:56.275409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:56.276161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:56.277176 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:56.277809 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:56.434824 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:56.444208 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:56.447738 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:56.449524 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-eab5df0c-6a69-48bf-af26-48f0ddf32880 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1738 microversion: 2.20 time: 0.188849 Jul 28 09:16:56.465105 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 308/598] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:56 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:56.901790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-78ad7c86-402f-4845-b465-393f10de28e2 req-7d2ba489-3178-4e56-9470-470202081d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886e113b-47d9-4760-bf0d-d5a2901b61f3", "tag": "5f846baf-d511-4258-bded-99970e48af03"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:16:56.912691 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-78ad7c86-402f-4845-b465-393f10de28e2 req-7d2ba489-3178-4e56-9470-470202081d2c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:56.913399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-78ad7c86-402f-4845-b465-393f10de28e2 req-7d2ba489-3178-4e56-9470-470202081d2c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:56.936801 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-78ad7c86-402f-4845-b465-393f10de28e2 req-7d2ba489-3178-4e56-9470-470202081d2c service nova] Creating event network-changed:5f846baf-d511-4258-bded-99970e48af03 for instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 on hv-cinder-85124 Jul 28 09:16:56.944028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-78ad7c86-402f-4845-b465-393f10de28e2 req-7d2ba489-3178-4e56-9470-470202081d2c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199589 Jul 28 09:16:56.945462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 291/599] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:57.474407 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:57.475860 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:57.480994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:16:57.499049 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:57.501884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:57.504342 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:57.504787 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:57.745775 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:57.759664 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:57.760811 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:57.762208 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8af2cbd2-fb65-4deb-a07f-36439309bcf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1738 microversion: 2.20 time: 0.293211 Jul 28 09:16:57.778510 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 309/600] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:57 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:58.786527 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:58.787207 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:58.793316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:58.793761 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:58.794533 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:58.794964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:58.931956 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:58.940460 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:58.941962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:16:58.943102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-45730235-58b0-4581-9229-596aa1339288 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1738 microversion: 2.20 time: 0.161385 Jul 28 09:16:58.943652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 292/601] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:58 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:16:59.966401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:59.967006 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:16:59.974196 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:59.974650 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:16:59.975449 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:16:59.976287 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:00.182395 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:00.190507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:00.191987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:00.193191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8778aa7d-ee72-445a-a6fe-73ec06292620 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1720 microversion: 2.20 time: 0.230578 Jul 28 09:17:00.193753 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 310/602] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:16:59 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:01.217940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:01.218473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:01.221575 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:01.227165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:01.227617 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:01.228392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:01.228834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:01.247997 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:01.361668 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:01.369530 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:01.371100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:01.372235 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-837dfcef-32e7-4e98-bc5a-ba017676405a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1720 microversion: 2.20 time: 0.158306 Jul 28 09:17:01.372782 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 293/603] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:01 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:02.395010 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:02.395619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:02.402228 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:02.402676 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:02.403439 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:02.403876 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:02.527531 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:02.529665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:02.537239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:02.538753 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:02.539896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3feeb119-4e63-41c6-a1e8-5b78dc2e190f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1723 microversion: 2.20 time: 0.148770 Jul 28 09:17:02.540442 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 311/604] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:02 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:02.562490 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f788499d-b5e0-40ac-a6fe-08819122574e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18e3c092-370f-4d19-aaab-7fc87c647a4f"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:17:02.565023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f788499d-b5e0-40ac-a6fe-08819122574e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:02.571599 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f788499d-b5e0-40ac-a6fe-08819122574e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:02.572043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f788499d-b5e0-40ac-a6fe-08819122574e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:02.572794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f788499d-b5e0-40ac-a6fe-08819122574e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:02.573222 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f788499d-b5e0-40ac-a6fe-08819122574e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:02.858909 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f788499d-b5e0-40ac-a6fe-08819122574e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300358 Jul 28 09:17:02.860228 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 294/605] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Jul 28 09:17:02 2022] POST /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:17:02.982138 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6edefa3a-ae92-4312-9a22-104b68338f02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:17:02.982749 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6edefa3a-ae92-4312-9a22-104b68338f02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:02.989100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6edefa3a-ae92-4312-9a22-104b68338f02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:02.989548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6edefa3a-ae92-4312-9a22-104b68338f02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:02.990328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6edefa3a-ae92-4312-9a22-104b68338f02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:02.990766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6edefa3a-ae92-4312-9a22-104b68338f02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:03.074847 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6edefa3a-ae92-4312-9a22-104b68338f02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117864) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 09:17:03.143168 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6edefa3a-ae92-4312-9a22-104b68338f02 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/action" status: 202 len: 0 microversion: 2.20 time: 0.164968 Jul 28 09:17:03.144035 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 312/606] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 09:17:02 2022] POST /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:17:03.151975 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:03.152586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:03.158583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:03.159032 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:03.159788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:03.160223 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:03.293971 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:03.302206 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:03.303750 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:03.304878 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-256a18f0-15c4-414f-9e6c-c7c105fa3923 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1749 microversion: 2.20 time: 0.156893 Jul 28 09:17:03.305425 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 295/607] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:03 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:04.023562 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-b52ade76-14de-4d51-bdee-f36e76d4a08b req-5fd491cd-26e4-4e6a-83ca-426a5338961c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145d502e-eb34-435a-8b8c-2ea6264d1506", "name": "network-vif-unplugged", "status": "completed", "tag": "51927101-a0e7-4577-83b1-566bb606eeb1"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:17:04.033763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b52ade76-14de-4d51-bdee-f36e76d4a08b req-5fd491cd-26e4-4e6a-83ca-426a5338961c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:04.034625 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b52ade76-14de-4d51-bdee-f36e76d4a08b req-5fd491cd-26e4-4e6a-83ca-426a5338961c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:04.046450 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.compute.server_external_events [req-b52ade76-14de-4d51-bdee-f36e76d4a08b req-5fd491cd-26e4-4e6a-83ca-426a5338961c service nova] Unable to find a host for instance 145d502e-eb34-435a-8b8c-2ea6264d1506. Dropping event network-vif-unplugged {{(pid=117864) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 09:17:04.047250 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-b52ade76-14de-4d51-bdee-f36e76d4a08b req-5fd491cd-26e4-4e6a-83ca-426a5338961c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028199 Jul 28 09:17:04.047886 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 313/608] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 09:17:04.328436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:04.329046 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:04.335432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:04.335869 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:04.336618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:04.337045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:04.460751 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:04.469069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:04.470591 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:04.472236 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ed55716d-823b-4a0b-a624-706ed6339ee6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1751 microversion: 2.20 time: 0.148019 Jul 28 09:17:04.472788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 296/609] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:04 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1751 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:05.495686 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:05.496301 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:05.503226 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:05.503681 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:05.504447 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:05.504884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:05.951317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:05.960116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:05.961602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:05.962779 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-deaaf9f3-9d6e-4532-9265-0c4bdfb98da6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.471133 Jul 28 09:17:05.963336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 314/610] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:05 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:06.987758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:06.988877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:06.997336 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:06.997796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:06.998702 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:06.999139 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:07.139405 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:07.148471 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:07.150013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:07.151231 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b53b9f86-4d19-48ea-b504-3bea1d2ac6b8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.168244 Jul 28 09:17:07.151982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 297/611] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:06 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:08.176558 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:08.177165 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:08.184360 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:08.184813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:08.185596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:08.186061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:08.340834 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:08.350160 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:08.351769 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:08.352946 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-370329be-c9f6-4e78-903a-0712ba4733c7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.181031 Jul 28 09:17:08.353890 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 315/612] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:08 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:09.379004 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:09.379640 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:09.386337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:09.386788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:09.387555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:09.387999 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:09.523200 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:09.532436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:09.533984 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:09.535160 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b64722e9-7981-4e93-8ca3-026c3a2c9764 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.160969 Jul 28 09:17:09.535719 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 298/613] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:09 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:10.558874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:10.559515 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:10.566691 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:10.567140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:10.567954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:10.568387 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:10.703225 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:10.712617 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:10.714172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:10.715337 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-eecc4aef-473c-4736-8378-5ab43de5b5ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.160733 Jul 28 09:17:10.716274 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 316/614] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:10 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:11.490369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6e768cda-1261-4521-a3eb-3bf0b726331e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc61b4da-39ca-4b30-9116-d9362e9d6d27"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:17:11.492838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6e768cda-1261-4521-a3eb-3bf0b726331e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:11.499223 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e768cda-1261-4521-a3eb-3bf0b726331e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:11.499677 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e768cda-1261-4521-a3eb-3bf0b726331e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:11.500449 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e768cda-1261-4521-a3eb-3bf0b726331e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:11.500888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e768cda-1261-4521-a3eb-3bf0b726331e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:11.739666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:11.740189 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:11.746671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:11.747116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:11.747873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:11.748305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:11.882792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:11.891485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:11.892961 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:11.894777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-38544ba7-06ac-449c-89e8-42b3374c409d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.159609 Jul 28 09:17:11.895325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 317/615] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:11 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:12.956531 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:12.960146 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:12.974364 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:12.974840 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:12.975743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:12.976193 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:13.142257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:13.151366 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:13.152864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:13.154066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6f4c3464-0148-4f1a-be3c-5d0255b4fad3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.238626 Jul 28 09:17:13.163927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 318/616] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:12 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:14.178939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:14.179650 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:14.186067 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:14.186509 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:14.187269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:14.187703 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:14.329483 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:14.339218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:14.340868 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:14.342359 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-23fc63a2-9c39-4339-b58b-409533e5e0b7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.168422 Jul 28 09:17:14.342998 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 319/617] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:14 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:15.364606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:15.365324 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:15.371568 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:15.372011 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:15.372775 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:15.373206 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:15.514506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:15.524006 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:15.525781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:15.526953 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-89688d5c-408f-410a-8baa-469c388614a7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.166362 Jul 28 09:17:15.527505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 320/618] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:15 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:16.550864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:16.551547 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:16.558802 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:16.559249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:16.560133 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:16.560579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:16.700173 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:16.709504 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:16.711025 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:16.712180 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7cd4a81c-6938-4da5-8423-003c88b40fcb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.165196 Jul 28 09:17:16.712919 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 321/619] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:16 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:17.735543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:17.736273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:17.743158 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:17.743610 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:17.744377 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:17.744808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:17.874180 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:17.882350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:17.883832 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:17.884993 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5795dd9c-3e61-40aa-afaa-98a4fbec2eec tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.153342 Jul 28 09:17:17.885547 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 322/620] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:17 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:18.908394 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:18.909063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:18.915653 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:18.916105 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:18.916898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:18.917343 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:19.044130 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:19.052474 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:19.054534 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:19.055683 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-20932d97-881e-4448-a475-bc689af46550 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.151239 Jul 28 09:17:19.056350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 323/621] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:18 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:20.079380 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:20.080087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:20.087037 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:20.087507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:20.088241 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:20.088675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:20.215125 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:20.223466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:20.224969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:20.226139 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c582687c-8431-4481-9bc4-ca985ba4a4ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.150863 Jul 28 09:17:20.226699 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 324/622] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:20 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:21.249011 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:21.249645 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:21.256708 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:21.257152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:21.257952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:21.258388 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:21.387930 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:21.396507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:21.398004 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:21.399130 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-62d7b8a4-72c7-4810-841f-91688a38a04d tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.154056 Jul 28 09:17:21.399710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 325/623] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:21 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:21.497250 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=13 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:21.573703 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:21.945749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6e768cda-1261-4521-a3eb-3bf0b726331e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.566355 Jul 28 09:17:21.946407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 299/624] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:17:11 2022] POST /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments => generated 194 bytes in 10568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:17:22.421204 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:22.421717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:22.428205 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:22.428680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:22.429396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:22.429829 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:22.559533 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:22.569042 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:22.570563 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:22.571907 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a43de205-880e-4339-9d29-b5cf404cd333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.154532 Jul 28 09:17:22.572455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 326/625] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:22 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:23.597304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:23.598021 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:23.605076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:23.605704 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:23.606792 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:23.607238 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:23.742464 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:23.750810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:23.752290 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:23.753433 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-be768619-f5c4-4e29-8b2c-3307b10ca950 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.161143 Jul 28 09:17:23.754023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 300/626] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:23 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:24.776849 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:24.777446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:24.783963 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:24.784400 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:24.785146 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:24.785575 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:24.911983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:24.920222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:24.921701 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:24.922883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-95bed2a3-29b9-4880-9cc3-b9af91be786f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.149897 Jul 28 09:17:24.923632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 327/627] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:24 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:25.944753 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:25.945386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:25.951791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:25.952230 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:25.953243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:25.953671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:26.085466 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:26.093756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:26.095284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:26.096433 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0a6f002a-e273-4bc9-8b09-6c67a82258f3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.155861 Jul 28 09:17:26.096990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 301/628] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:25 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:27.118942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:27.119480 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:27.125910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:27.126360 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:27.127118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:27.127549 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:27.130053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:27.259067 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:27.267412 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:27.268935 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:27.270100 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dd65f2f8-9318-4baf-baaa-c5d1d88929f9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.155723 Jul 28 09:17:27.270648 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 328/629] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:27 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:28.293139 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:28.293749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:28.300085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:28.300523 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:28.301277 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:28.301707 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:28.426803 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:28.435020 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:28.436512 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:28.437649 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-99ed8009-9c4b-42f8-9c85-0e4ab70e209b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.148695 Jul 28 09:17:28.438288 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 302/630] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:28 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:29.462317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:29.462916 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:29.465206 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:29.470437 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:29.470881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:29.471627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:29.472060 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:29.603189 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:29.612621 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:29.614103 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:29.615762 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e8afe8df-bd46-4bb8-9d3a-f34b26e8ff38 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.157438 Jul 28 09:17:29.616393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 329/631] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:29 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:30.516591 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ca5916eb-2c9c-40ec-b56e-3e06ad6d36fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:17:30.518885 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ca5916eb-2c9c-40ec-b56e-3e06ad6d36fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:30.525328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca5916eb-2c9c-40ec-b56e-3e06ad6d36fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:30.525773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca5916eb-2c9c-40ec-b56e-3e06ad6d36fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:30.526567 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca5916eb-2c9c-40ec-b56e-3e06ad6d36fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:30.527000 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca5916eb-2c9c-40ec-b56e-3e06ad6d36fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:30.548890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-ca5916eb-2c9c-40ec-b56e-3e06ad6d36fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lazy-loading 'flavor' on Instance uuid c5f77207-4c9e-4c6b-8948-d42f1f28c4aa {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:17:30.642682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:30.643354 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:30.650028 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:30.650580 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:30.651248 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:30.651695 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:30.671285 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ca5916eb-2c9c-40ec-b56e-3e06ad6d36fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/action" status: 200 len: 32 microversion: 2.1 time: 0.158572 Jul 28 09:17:30.672301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 303/632] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:17:30 2022] POST /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:17:30.684214 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-02dc21a9-6adb-483d-af2c-16ba9a7c6068 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:30.684995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-02dc21a9-6adb-483d-af2c-16ba9a7c6068 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:30.691948 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-02dc21a9-6adb-483d-af2c-16ba9a7c6068 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:30.692502 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-02dc21a9-6adb-483d-af2c-16ba9a7c6068 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:30.693435 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-02dc21a9-6adb-483d-af2c-16ba9a7c6068 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:30.694026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-02dc21a9-6adb-483d-af2c-16ba9a7c6068 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:30.941336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:30.949751 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:30.951269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:30.952419 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f87fea30-3342-4f10-9e7b-255b670cd9f7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.313672 Jul 28 09:17:30.952979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 330/633] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:30 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:30.958328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-02dc21a9-6adb-483d-af2c-16ba9a7c6068 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:30.968792 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-02dc21a9-6adb-483d-af2c-16ba9a7c6068 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.288790 Jul 28 09:17:30.970182 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 304/634] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:30 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:31.981341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:31.981906 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:31.988500 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:31.988952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:31.989715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:31.990183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:31.992636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2a7b2c59-c756-4fdc-bcb8-fd3fb26bdc14 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:31.993249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2a7b2c59-c756-4fdc-bcb8-fd3fb26bdc14 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:32.000054 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7b2c59-c756-4fdc-bcb8-fd3fb26bdc14 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:32.000505 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7b2c59-c756-4fdc-bcb8-fd3fb26bdc14 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:32.001301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7b2c59-c756-4fdc-bcb8-fd3fb26bdc14 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:32.001740 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7b2c59-c756-4fdc-bcb8-fd3fb26bdc14 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:32.183994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:32.188142 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2a7b2c59-c756-4fdc-bcb8-fd3fb26bdc14 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:32.192827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:32.195024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:32.196532 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-23b97043-130c-4e58-acd9-f89333b3fad6 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.219186 Jul 28 09:17:32.197254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 331/635] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:31 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:32.209678 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2a7b2c59-c756-4fdc-bcb8-fd3fb26bdc14 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.209105 Jul 28 09:17:32.210742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 305/636] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:31 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:17:32.273222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-b3bd0722-3436-43a0-986a-82b2fca798ac req-881416d1-754b-498e-a87b-e2ccdeed0e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145d502e-eb34-435a-8b8c-2ea6264d1506", "name": "network-vif-plugged", "status": "completed", "tag": "51927101-a0e7-4577-83b1-566bb606eeb1"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:17:32.284781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b3bd0722-3436-43a0-986a-82b2fca798ac req-881416d1-754b-498e-a87b-e2ccdeed0e9e service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:32.285432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b3bd0722-3436-43a0-986a-82b2fca798ac req-881416d1-754b-498e-a87b-e2ccdeed0e9e service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:32.297278 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-b3bd0722-3436-43a0-986a-82b2fca798ac req-881416d1-754b-498e-a87b-e2ccdeed0e9e service nova] Creating event network-vif-plugged:51927101-a0e7-4577-83b1-566bb606eeb1 for instance 145d502e-eb34-435a-8b8c-2ea6264d1506 on hv-cinder-85124 Jul 28 09:17:32.302677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-b3bd0722-3436-43a0-986a-82b2fca798ac req-881416d1-754b-498e-a87b-e2ccdeed0e9e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101589 Jul 28 09:17:32.303292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 332/637] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:17:33.220518 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:33.221034 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:33.227467 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:33.227915 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:33.228673 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:33.229104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:33.232319 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aeae5fa2-64df-494b-8c25-1d90f95d8764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:33.233020 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-aeae5fa2-64df-494b-8c25-1d90f95d8764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:33.239381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aeae5fa2-64df-494b-8c25-1d90f95d8764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:33.239829 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aeae5fa2-64df-494b-8c25-1d90f95d8764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:33.241144 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aeae5fa2-64df-494b-8c25-1d90f95d8764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:33.241599 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aeae5fa2-64df-494b-8c25-1d90f95d8764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:33.431230 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:33.434197 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-aeae5fa2-64df-494b-8c25-1d90f95d8764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:33.439902 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:33.441475 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:33.441976 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aeae5fa2-64df-494b-8c25-1d90f95d8764 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.214352 Jul 28 09:17:33.442539 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 333/638] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:33 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:17:33.442883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8b90ee93-5384-48f0-a09f-2e36feeb5d2c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.226346 Jul 28 09:17:33.444065 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 306/639] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:33 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:17:34.463412 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3df76acd-a33c-4e0f-bddb-f80d3e59ad27 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:34.464018 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3df76acd-a33c-4e0f-bddb-f80d3e59ad27 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:34.466473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:34.467079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:34.470581 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3df76acd-a33c-4e0f-bddb-f80d3e59ad27 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:34.471025 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3df76acd-a33c-4e0f-bddb-f80d3e59ad27 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:34.471782 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3df76acd-a33c-4e0f-bddb-f80d3e59ad27 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:34.472217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3df76acd-a33c-4e0f-bddb-f80d3e59ad27 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:34.473420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:34.473890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:34.474653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:34.475107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:34.665771 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3df76acd-a33c-4e0f-bddb-f80d3e59ad27 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:34.670201 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:34.673941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3df76acd-a33c-4e0f-bddb-f80d3e59ad27 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.214985 Jul 28 09:17:34.674511 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 334/640] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:34 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:34.678665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:34.680226 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:34.681448 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0f5fc6fc-afc5-4f1e-aeb1-ae91cc9e565f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1807 microversion: 2.20 time: 0.218768 Jul 28 09:17:34.682104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 307/641] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:34 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:35.694653 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4622e3ad-cd18-4ff2-a25f-a15e7cdc8c5c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:35.695256 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4622e3ad-cd18-4ff2-a25f-a15e7cdc8c5c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:35.701830 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4622e3ad-cd18-4ff2-a25f-a15e7cdc8c5c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:35.702299 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4622e3ad-cd18-4ff2-a25f-a15e7cdc8c5c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:35.703066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4622e3ad-cd18-4ff2-a25f-a15e7cdc8c5c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:35.703759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4622e3ad-cd18-4ff2-a25f-a15e7cdc8c5c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:35.704420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:35.705028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:35.711661 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:35.712111 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:35.712874 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:35.713311 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:35.901403 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4622e3ad-cd18-4ff2-a25f-a15e7cdc8c5c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:35.904626 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:35.909596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4622e3ad-cd18-4ff2-a25f-a15e7cdc8c5c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.218805 Jul 28 09:17:35.910616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 335/642] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:35 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:35.913281 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:35.914822 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:35.915976 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2f3cc267-5bf1-4aae-abae-ccbacd5db93e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1794 microversion: 2.20 time: 0.215541 Jul 28 09:17:35.916520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 308/643] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:17:35 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1794 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:17:36.931746 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-36397836-6e27-40e7-8b3a-3d9a4a7bcf12 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:36.932353 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-36397836-6e27-40e7-8b3a-3d9a4a7bcf12 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:36.938807 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-36397836-6e27-40e7-8b3a-3d9a4a7bcf12 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:36.939253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-36397836-6e27-40e7-8b3a-3d9a4a7bcf12 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:36.940005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-36397836-6e27-40e7-8b3a-3d9a4a7bcf12 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:36.940436 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-36397836-6e27-40e7-8b3a-3d9a4a7bcf12 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:37.075275 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-36397836-6e27-40e7-8b3a-3d9a4a7bcf12 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:37.083357 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-36397836-6e27-40e7-8b3a-3d9a4a7bcf12 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.156060 Jul 28 09:17:37.084490 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 336/644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:36 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:38.105079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-45ca7fab-a8b8-4dc0-b938-995a912615e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:38.105705 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-45ca7fab-a8b8-4dc0-b938-995a912615e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:38.112145 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-45ca7fab-a8b8-4dc0-b938-995a912615e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:38.112587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-45ca7fab-a8b8-4dc0-b938-995a912615e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:38.113336 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-45ca7fab-a8b8-4dc0-b938-995a912615e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:38.113764 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-45ca7fab-a8b8-4dc0-b938-995a912615e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:38.238200 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-45ca7fab-a8b8-4dc0-b938-995a912615e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:38.246693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-45ca7fab-a8b8-4dc0-b938-995a912615e5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.145509 Jul 28 09:17:38.247247 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 309/645] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:38 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:39.267812 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-32925bf4-16ef-41a4-861c-3527185cc1bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:39.268353 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-32925bf4-16ef-41a4-861c-3527185cc1bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:39.275101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-32925bf4-16ef-41a4-861c-3527185cc1bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:39.275604 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-32925bf4-16ef-41a4-861c-3527185cc1bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:39.276314 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-32925bf4-16ef-41a4-861c-3527185cc1bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:39.276746 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-32925bf4-16ef-41a4-861c-3527185cc1bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:39.403031 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-32925bf4-16ef-41a4-861c-3527185cc1bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:39.410870 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-32925bf4-16ef-41a4-861c-3527185cc1bc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.146983 Jul 28 09:17:39.411429 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 337/646] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:39 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:40.433493 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-03ae172d-3a06-4614-a998-acc49bd6f0b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:40.434120 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-03ae172d-3a06-4614-a998-acc49bd6f0b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:40.442026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-03ae172d-3a06-4614-a998-acc49bd6f0b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:40.442473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-03ae172d-3a06-4614-a998-acc49bd6f0b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:40.443230 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-03ae172d-3a06-4614-a998-acc49bd6f0b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:40.443662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-03ae172d-3a06-4614-a998-acc49bd6f0b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:40.575825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-03ae172d-3a06-4614-a998-acc49bd6f0b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:40.584340 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-03ae172d-3a06-4614-a998-acc49bd6f0b2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.155187 Jul 28 09:17:40.584905 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 310/647] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:40 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:41.605774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b9d54b90-741a-4772-be56-6cb96a40b804 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:41.606406 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b9d54b90-741a-4772-be56-6cb96a40b804 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:41.612885 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b9d54b90-741a-4772-be56-6cb96a40b804 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:41.613327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b9d54b90-741a-4772-be56-6cb96a40b804 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:41.614110 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b9d54b90-741a-4772-be56-6cb96a40b804 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:41.614544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b9d54b90-741a-4772-be56-6cb96a40b804 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:41.739556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b9d54b90-741a-4772-be56-6cb96a40b804 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:41.747414 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b9d54b90-741a-4772-be56-6cb96a40b804 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.145407 Jul 28 09:17:41.747976 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 338/648] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:41 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:42.767975 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3c38f007-da09-4b3c-aa47-ae3fba1335c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:42.768583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3c38f007-da09-4b3c-aa47-ae3fba1335c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:42.775131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3c38f007-da09-4b3c-aa47-ae3fba1335c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:42.775586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3c38f007-da09-4b3c-aa47-ae3fba1335c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:42.776348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3c38f007-da09-4b3c-aa47-ae3fba1335c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:42.776786 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3c38f007-da09-4b3c-aa47-ae3fba1335c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:42.905010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3c38f007-da09-4b3c-aa47-ae3fba1335c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:42.913468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3c38f007-da09-4b3c-aa47-ae3fba1335c1 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.149342 Jul 28 09:17:42.914058 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 311/649] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:42 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:43.934377 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8dccd6ab-c32d-4fc3-bc23-b9ebc1f24f8f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:43.934992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8dccd6ab-c32d-4fc3-bc23-b9ebc1f24f8f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:43.941505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8dccd6ab-c32d-4fc3-bc23-b9ebc1f24f8f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:43.941992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8dccd6ab-c32d-4fc3-bc23-b9ebc1f24f8f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:43.942754 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8dccd6ab-c32d-4fc3-bc23-b9ebc1f24f8f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:43.943842 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8dccd6ab-c32d-4fc3-bc23-b9ebc1f24f8f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:44.070681 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8dccd6ab-c32d-4fc3-bc23-b9ebc1f24f8f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:44.078687 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8dccd6ab-c32d-4fc3-bc23-b9ebc1f24f8f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.147897 Jul 28 09:17:44.079248 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 339/650] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:43 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:45.100503 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a9645bd1-96c8-49c4-b865-277241e9222c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:45.101105 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a9645bd1-96c8-49c4-b865-277241e9222c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:45.109009 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a9645bd1-96c8-49c4-b865-277241e9222c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:45.109452 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a9645bd1-96c8-49c4-b865-277241e9222c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:45.110241 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a9645bd1-96c8-49c4-b865-277241e9222c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:45.110671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a9645bd1-96c8-49c4-b865-277241e9222c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:45.241320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a9645bd1-96c8-49c4-b865-277241e9222c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:45.249227 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a9645bd1-96c8-49c4-b865-277241e9222c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.153438 Jul 28 09:17:45.249784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 312/651] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:45 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:46.270663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-555a04e7-3b2d-4e73-b45e-2ce5ad07b02c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:46.271231 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-555a04e7-3b2d-4e73-b45e-2ce5ad07b02c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:46.277394 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-555a04e7-3b2d-4e73-b45e-2ce5ad07b02c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:46.277862 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-555a04e7-3b2d-4e73-b45e-2ce5ad07b02c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:46.278647 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-555a04e7-3b2d-4e73-b45e-2ce5ad07b02c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:46.279090 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-555a04e7-3b2d-4e73-b45e-2ce5ad07b02c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:46.404606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-555a04e7-3b2d-4e73-b45e-2ce5ad07b02c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:46.412433 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-555a04e7-3b2d-4e73-b45e-2ce5ad07b02c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.145711 Jul 28 09:17:46.413499 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 340/652] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:46 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:47.434557 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4532314c-4eb9-4958-be74-a81d56356bf2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:47.435212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4532314c-4eb9-4958-be74-a81d56356bf2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:47.441601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4532314c-4eb9-4958-be74-a81d56356bf2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:47.442094 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4532314c-4eb9-4958-be74-a81d56356bf2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:47.442850 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4532314c-4eb9-4958-be74-a81d56356bf2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:47.443284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4532314c-4eb9-4958-be74-a81d56356bf2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:47.448144 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:47.570773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4532314c-4eb9-4958-be74-a81d56356bf2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:47.578980 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4532314c-4eb9-4958-be74-a81d56356bf2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.148048 Jul 28 09:17:47.579538 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 313/653] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:47 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:48.600098 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-574d84df-9e1e-4c51-9d53-c570a169f691 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:48.600646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-574d84df-9e1e-4c51-9d53-c570a169f691 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:48.607071 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-574d84df-9e1e-4c51-9d53-c570a169f691 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:48.607517 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-574d84df-9e1e-4c51-9d53-c570a169f691 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:48.608271 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-574d84df-9e1e-4c51-9d53-c570a169f691 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:48.608708 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-574d84df-9e1e-4c51-9d53-c570a169f691 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:48.736980 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-574d84df-9e1e-4c51-9d53-c570a169f691 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:48.744864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-574d84df-9e1e-4c51-9d53-c570a169f691 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.148662 Jul 28 09:17:48.745427 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 341/654] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:48 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:49.766320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0faaadce-5231-4955-8513-a24108d46369 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:49.766934 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0faaadce-5231-4955-8513-a24108d46369 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:49.773379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0faaadce-5231-4955-8513-a24108d46369 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:49.773860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0faaadce-5231-4955-8513-a24108d46369 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:49.774624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0faaadce-5231-4955-8513-a24108d46369 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:49.775059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0faaadce-5231-4955-8513-a24108d46369 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:49.899535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0faaadce-5231-4955-8513-a24108d46369 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:49.907422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0faaadce-5231-4955-8513-a24108d46369 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.144952 Jul 28 09:17:49.907991 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 314/655] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:49 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:50.929260 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a13cc5c1-7346-4ac8-84a1-595f09157e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:50.929899 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a13cc5c1-7346-4ac8-84a1-595f09157e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:50.936471 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a13cc5c1-7346-4ac8-84a1-595f09157e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:50.936921 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a13cc5c1-7346-4ac8-84a1-595f09157e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:50.937688 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a13cc5c1-7346-4ac8-84a1-595f09157e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:50.938161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a13cc5c1-7346-4ac8-84a1-595f09157e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:51.065800 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a13cc5c1-7346-4ac8-84a1-595f09157e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:51.074780 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a13cc5c1-7346-4ac8-84a1-595f09157e1b tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.150039 Jul 28 09:17:51.075347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 342/656] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:50 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:52.096918 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1b3267ba-879e-44ec-93b0-27bb9fd677d2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:52.097521 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1b3267ba-879e-44ec-93b0-27bb9fd677d2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:52.099915 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=31 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:52.105659 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1b3267ba-879e-44ec-93b0-27bb9fd677d2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:52.106139 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1b3267ba-879e-44ec-93b0-27bb9fd677d2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:52.106901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1b3267ba-879e-44ec-93b0-27bb9fd677d2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:52.107341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1b3267ba-879e-44ec-93b0-27bb9fd677d2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:52.233430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1b3267ba-879e-44ec-93b0-27bb9fd677d2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:52.241423 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1b3267ba-879e-44ec-93b0-27bb9fd677d2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.148329 Jul 28 09:17:52.242024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 315/657] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:52 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:53.262874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0277b560-abc1-49b9-bbed-2b4edbaf5c9f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:53.263418 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0277b560-abc1-49b9-bbed-2b4edbaf5c9f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:53.269792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0277b560-abc1-49b9-bbed-2b4edbaf5c9f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:53.270268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0277b560-abc1-49b9-bbed-2b4edbaf5c9f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:53.271018 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0277b560-abc1-49b9-bbed-2b4edbaf5c9f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:53.271475 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0277b560-abc1-49b9-bbed-2b4edbaf5c9f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:53.398390 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0277b560-abc1-49b9-bbed-2b4edbaf5c9f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:53.406248 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0277b560-abc1-49b9-bbed-2b4edbaf5c9f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.147281 Jul 28 09:17:53.406802 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 343/658] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:53 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:54.428320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-840337ed-cefd-40c3-9f12-0e319f7f5736 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:54.429411 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-840337ed-cefd-40c3-9f12-0e319f7f5736 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:54.436402 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-840337ed-cefd-40c3-9f12-0e319f7f5736 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:54.436846 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-840337ed-cefd-40c3-9f12-0e319f7f5736 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:54.437601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-840337ed-cefd-40c3-9f12-0e319f7f5736 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:54.438061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-840337ed-cefd-40c3-9f12-0e319f7f5736 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:54.563363 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-840337ed-cefd-40c3-9f12-0e319f7f5736 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:54.571237 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-840337ed-cefd-40c3-9f12-0e319f7f5736 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.147026 Jul 28 09:17:54.571802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 316/659] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:54 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:54.704876 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-77530b0b-6a21-4a05-b622-8b96d52892d9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:54.705418 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-77530b0b-6a21-4a05-b622-8b96d52892d9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:54.711942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-77530b0b-6a21-4a05-b622-8b96d52892d9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:54.712387 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-77530b0b-6a21-4a05-b622-8b96d52892d9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:54.713144 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-77530b0b-6a21-4a05-b622-8b96d52892d9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:54.713582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-77530b0b-6a21-4a05-b622-8b96d52892d9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:54.792850 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-77530b0b-6a21-4a05-b622-8b96d52892d9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lazy-loading 'services' on Instance uuid 6936b19d-2a6d-4b60-a88f-549320d81537 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:17:54.851586 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:54.863635 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-77530b0b-6a21-4a05-b622-8b96d52892d9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/os-volume_attachments/f8ffcace-88ce-4ac0-b083-6b7dc465dca1" status: 202 len: 0 microversion: 2.1 time: 0.162859 Jul 28 09:17:54.864208 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 344/660] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:17:54 2022] DELETE /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/os-volume_attachments/f8ffcace-88ce-4ac0-b083-6b7dc465dca1 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:17:55.592612 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-92ce3898-1a32-4e01-81ae-20756049e7f4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:55.593218 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-92ce3898-1a32-4e01-81ae-20756049e7f4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:55.599677 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ce3898-1a32-4e01-81ae-20756049e7f4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:55.600125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ce3898-1a32-4e01-81ae-20756049e7f4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:55.600882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ce3898-1a32-4e01-81ae-20756049e7f4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:55.601317 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ce3898-1a32-4e01-81ae-20756049e7f4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:55.729048 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-92ce3898-1a32-4e01-81ae-20756049e7f4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:55.737338 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-92ce3898-1a32-4e01-81ae-20756049e7f4 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1734 microversion: 2.1 time: 0.148632 Jul 28 09:17:55.737936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 317/661] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:55 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:56.760446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a737475a-1c2b-43c5-a48e-3306032fbd3e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:56.761133 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a737475a-1c2b-43c5-a48e-3306032fbd3e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:56.767417 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a737475a-1c2b-43c5-a48e-3306032fbd3e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:56.767858 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a737475a-1c2b-43c5-a48e-3306032fbd3e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:56.768619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a737475a-1c2b-43c5-a48e-3306032fbd3e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:56.769048 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a737475a-1c2b-43c5-a48e-3306032fbd3e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:56.901694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a737475a-1c2b-43c5-a48e-3306032fbd3e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:56.909681 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a737475a-1c2b-43c5-a48e-3306032fbd3e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1714 microversion: 2.1 time: 0.154083 Jul 28 09:17:56.910279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 345/662] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:56 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:56.969470 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:56.970000 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:56.976321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:56.976788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:56.977533 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:56.977990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:57.035387 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7362d67f-6041-4585-a219-9220cabd2a95 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:17:57.041335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7362d67f-6041-4585-a219-9220cabd2a95 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:57.041779 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7362d67f-6041-4585-a219-9220cabd2a95 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:57.060892 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] HTTP exception thrown: Cannot 'detach_volume' instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa while it is in vm_state rescued Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Request method failure captured: Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: DELETE /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments/cc61b4da-39ca-4b30-9116-d9362e9d6d27 HTTP/1.1 Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLAPGLX22q_Q72umgmxlgc_aqO594bbQCBzsIS-QcLuSvE8L3peXSJgCX3ZJfsFRvFXmpkeBL9AYxhV3YxULcppJgQE7K3YNuKQNhmzaeAPYyj2sHvKJe3wq4C7OwoS0ZyBeINcu4yhntqqK6I0lgT33c7MoghbwUrepU-74mtzo-c Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:17:57.062566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34cb634f5c154187a943a454a706f200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34cb634f5c154187a943a454a706f200", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}] Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: aff89a63c86f4e6f906988791f3c5258 Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:17:57.063939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Cannot 'detach_volume' instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa while it is in vm_state rescued Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'server_id': 'c5f77207-4c9e-4c6b-8948-d42f1f28c4aa', 'id': 'cc61b4da-39ca-4b30-9116-d9362e9d6d27'} Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:17:57.064622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa while it is in vm_state rescued Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa while it is in vm_state rescued Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:17:57.065825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Returning 409 to user: Cannot 'detach_volume' instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa while it is in vm_state rescued {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:17:57.066831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4a5a5394-68e7-42bc-aa1c-19dc54a2e3fc tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments/cc61b4da-39ca-4b30-9116-d9362e9d6d27" status: 409 len: 152 microversion: 2.1 time: 0.098525 Jul 28 09:17:57.066831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 318/663] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:17:56 2022] DELETE /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments/cc61b4da-39ca-4b30-9116-d9362e9d6d27 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 09:17:57.066972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7362d67f-6041-4585-a219-9220cabd2a95 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Going to try to stop instance {{(pid=117864) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 09:17:57.074901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-baaeae0d-c310-45c0-b91d-0edf6af0bfcd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:17:57.075695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-baaeae0d-c310-45c0-b91d-0edf6af0bfcd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:57.090567 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-baaeae0d-c310-45c0-b91d-0edf6af0bfcd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:57.091116 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-baaeae0d-c310-45c0-b91d-0edf6af0bfcd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:57.091953 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-baaeae0d-c310-45c0-b91d-0edf6af0bfcd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:57.092455 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-baaeae0d-c310-45c0-b91d-0edf6af0bfcd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:57.115714 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7362d67f-6041-4585-a219-9220cabd2a95 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/action" status: 202 len: 0 microversion: 2.1 time: 0.083948 Jul 28 09:17:57.116462 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 346/664] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:17:57 2022] POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:17:57.124825 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c4c79d88-cdf5-44cf-a255-7f8ee67eb353 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:57.125619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c4c79d88-cdf5-44cf-a255-7f8ee67eb353 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:57.132657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c4c79d88-cdf5-44cf-a255-7f8ee67eb353 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:57.133675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c4c79d88-cdf5-44cf-a255-7f8ee67eb353 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:57.134298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c4c79d88-cdf5-44cf-a255-7f8ee67eb353 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:57.134974 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c4c79d88-cdf5-44cf-a255-7f8ee67eb353 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:57.165881 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-baaeae0d-c310-45c0-b91d-0edf6af0bfcd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "POST /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/action" status: 202 len: 0 microversion: 2.1 time: 0.094679 Jul 28 09:17:57.166497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 319/665] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:17:57 2022] POST /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:17:57.175225 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-98ea2a8a-cfa9-4383-b5b4-afda2d3f5847 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:57.175902 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-98ea2a8a-cfa9-4383-b5b4-afda2d3f5847 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:57.182851 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-98ea2a8a-cfa9-4383-b5b4-afda2d3f5847 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:57.183295 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-98ea2a8a-cfa9-4383-b5b4-afda2d3f5847 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:57.184054 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-98ea2a8a-cfa9-4383-b5b4-afda2d3f5847 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:57.184486 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-98ea2a8a-cfa9-4383-b5b4-afda2d3f5847 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:57.316603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c4c79d88-cdf5-44cf-a255-7f8ee67eb353 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:57.324736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c4c79d88-cdf5-44cf-a255-7f8ee67eb353 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.203980 Jul 28 09:17:57.325305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 347/666] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:57 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:17:57.346600 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-98ea2a8a-cfa9-4383-b5b4-afda2d3f5847 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:57.354853 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-98ea2a8a-cfa9-4383-b5b4-afda2d3f5847 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1722 microversion: 2.1 time: 0.183559 Jul 28 09:17:57.355425 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 320/667] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:57 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:17:58.345682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4112a358-99b4-47bd-983d-9d966259b6f1 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:58.346269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4112a358-99b4-47bd-983d-9d966259b6f1 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:58.352663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4112a358-99b4-47bd-983d-9d966259b6f1 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:58.353108 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4112a358-99b4-47bd-983d-9d966259b6f1 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:58.353887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4112a358-99b4-47bd-983d-9d966259b6f1 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:58.354324 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4112a358-99b4-47bd-983d-9d966259b6f1 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:58.376522 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5b56f75d-3d8a-4b6d-b598-b036376aa9ab tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:58.377129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5b56f75d-3d8a-4b6d-b598-b036376aa9ab tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:58.384215 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5b56f75d-3d8a-4b6d-b598-b036376aa9ab tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:58.384671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5b56f75d-3d8a-4b6d-b598-b036376aa9ab tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:58.385437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5b56f75d-3d8a-4b6d-b598-b036376aa9ab tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:58.385900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5b56f75d-3d8a-4b6d-b598-b036376aa9ab tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:58.533905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4112a358-99b4-47bd-983d-9d966259b6f1 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:58.542346 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4112a358-99b4-47bd-983d-9d966259b6f1 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.200474 Jul 28 09:17:58.543185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 348/668] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:58 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:17:58.556224 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5b56f75d-3d8a-4b6d-b598-b036376aa9ab tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:58.564195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5b56f75d-3d8a-4b6d-b598-b036376aa9ab tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1722 microversion: 2.1 time: 0.191509 Jul 28 09:17:58.564745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 321/669] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:58 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:17:59.563571 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a961fdb8-1459-4e02-aa84-f6ea258d799b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:59.564175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a961fdb8-1459-4e02-aa84-f6ea258d799b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:59.566573 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=40 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:59.572214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a961fdb8-1459-4e02-aa84-f6ea258d799b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:59.572661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a961fdb8-1459-4e02-aa84-f6ea258d799b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:59.573426 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a961fdb8-1459-4e02-aa84-f6ea258d799b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:59.573985 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a961fdb8-1459-4e02-aa84-f6ea258d799b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:59.586013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-119469dc-0b97-4865-8e3a-f13e5191a681 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:59.586617 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-119469dc-0b97-4865-8e3a-f13e5191a681 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:17:59.592984 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-119469dc-0b97-4865-8e3a-f13e5191a681 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:59.593429 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-119469dc-0b97-4865-8e3a-f13e5191a681 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:59.594214 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-119469dc-0b97-4865-8e3a-f13e5191a681 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:17:59.594644 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-119469dc-0b97-4865-8e3a-f13e5191a681 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:17:59.762451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a961fdb8-1459-4e02-aa84-f6ea258d799b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:59.769804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a961fdb8-1459-4e02-aa84-f6ea258d799b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.210084 Jul 28 09:17:59.770401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 349/670] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:59 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:17:59.774143 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-119469dc-0b97-4865-8e3a-f13e5191a681 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:17:59.782186 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-119469dc-0b97-4865-8e3a-f13e5191a681 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1722 microversion: 2.1 time: 0.200583 Jul 28 09:17:59.782745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 322/671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:17:59 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:00.792351 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7a788aae-0d96-4279-ad05-de4e1fcc2038 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:00.792954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7a788aae-0d96-4279-ad05-de4e1fcc2038 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:00.799879 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a788aae-0d96-4279-ad05-de4e1fcc2038 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:00.800328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a788aae-0d96-4279-ad05-de4e1fcc2038 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:00.801081 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a788aae-0d96-4279-ad05-de4e1fcc2038 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:00.801513 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a788aae-0d96-4279-ad05-de4e1fcc2038 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:00.804340 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4d4ea48a-ffe7-4f90-89ea-b0488a3ab2f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:00.804954 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4d4ea48a-ffe7-4f90-89ea-b0488a3ab2f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:00.811439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4d4ea48a-ffe7-4f90-89ea-b0488a3ab2f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:00.811886 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4d4ea48a-ffe7-4f90-89ea-b0488a3ab2f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:00.812685 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4d4ea48a-ffe7-4f90-89ea-b0488a3ab2f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:00.813119 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4d4ea48a-ffe7-4f90-89ea-b0488a3ab2f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:00.997538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7a788aae-0d96-4279-ad05-de4e1fcc2038 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:01.001379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4d4ea48a-ffe7-4f90-89ea-b0488a3ab2f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:01.005136 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7a788aae-0d96-4279-ad05-de4e1fcc2038 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.217418 Jul 28 09:18:01.005712 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 350/672] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:00 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:01.009525 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4d4ea48a-ffe7-4f90-89ea-b0488a3ab2f6 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1722 microversion: 2.1 time: 0.209537 Jul 28 09:18:01.010268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 323/673] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:00 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:02.026604 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-47936b95-aa49-4924-a298-398dd19ae70b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:02.027129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-47936b95-aa49-4924-a298-398dd19ae70b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:02.029771 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c6f789d6-3c07-4076-943d-9d647bfc8f36 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:02.030418 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c6f789d6-3c07-4076-943d-9d647bfc8f36 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:02.033564 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47936b95-aa49-4924-a298-398dd19ae70b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:02.034049 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47936b95-aa49-4924-a298-398dd19ae70b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:02.034846 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47936b95-aa49-4924-a298-398dd19ae70b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:02.035283 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47936b95-aa49-4924-a298-398dd19ae70b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:02.036822 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c6f789d6-3c07-4076-943d-9d647bfc8f36 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:02.037271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c6f789d6-3c07-4076-943d-9d647bfc8f36 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:02.038064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c6f789d6-3c07-4076-943d-9d647bfc8f36 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:02.038501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c6f789d6-3c07-4076-943d-9d647bfc8f36 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:02.222858 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-47936b95-aa49-4924-a298-398dd19ae70b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:02.231665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-47936b95-aa49-4924-a298-398dd19ae70b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.208792 Jul 28 09:18:02.232062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 351/674] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:02 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:02.234526 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c6f789d6-3c07-4076-943d-9d647bfc8f36 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:02.243374 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c6f789d6-3c07-4076-943d-9d647bfc8f36 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1728 microversion: 2.1 time: 0.217282 Jul 28 09:18:02.243917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 324/675] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:02 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:02.265096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1928c3fc-581f-4d47-8d0e-e846bc57a94a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:02.265589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1928c3fc-581f-4d47-8d0e-e846bc57a94a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:02.271445 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1928c3fc-581f-4d47-8d0e-e846bc57a94a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:02.271892 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1928c3fc-581f-4d47-8d0e-e846bc57a94a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:02.272652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1928c3fc-581f-4d47-8d0e-e846bc57a94a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:02.273089 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1928c3fc-581f-4d47-8d0e-e846bc57a94a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:02.351140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1928c3fc-581f-4d47-8d0e-e846bc57a94a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090283 Jul 28 09:18:02.352380 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 352/676] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 09:18:02 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:03.254078 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cf57563e-2b42-463a-be64-e81c9b8ccc1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:03.254729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cf57563e-2b42-463a-be64-e81c9b8ccc1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:03.262287 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cf57563e-2b42-463a-be64-e81c9b8ccc1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:03.262570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cf57563e-2b42-463a-be64-e81c9b8ccc1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:03.263338 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cf57563e-2b42-463a-be64-e81c9b8ccc1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:03.264205 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cf57563e-2b42-463a-be64-e81c9b8ccc1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:03.292680 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-5d28937d-3484-4904-a7cb-99816356d880 req-6361501a-ca4c-4d60-a5a7-f6d1a8aff0da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f77207-4c9e-4c6b-8948-d42f1f28c4aa", "tag": "433c3376-c310-4c2a-80fa-815d10d185aa"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:03.302876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-5d28937d-3484-4904-a7cb-99816356d880 req-6361501a-ca4c-4d60-a5a7-f6d1a8aff0da service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:03.303305 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-5d28937d-3484-4904-a7cb-99816356d880 req-6361501a-ca4c-4d60-a5a7-f6d1a8aff0da service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:03.314773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-5d28937d-3484-4904-a7cb-99816356d880 req-6361501a-ca4c-4d60-a5a7-f6d1a8aff0da service nova] Creating event network-changed:433c3376-c310-4c2a-80fa-815d10d185aa for instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa on hv-cinder-85124 Jul 28 09:18:03.319849 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-5d28937d-3484-4904-a7cb-99816356d880 req-6361501a-ca4c-4d60-a5a7-f6d1a8aff0da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092713 Jul 28 09:18:03.320724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 325/677] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:03.429563 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cf57563e-2b42-463a-be64-e81c9b8ccc1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:03.437372 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cf57563e-2b42-463a-be64-e81c9b8ccc1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.187569 Jul 28 09:18:03.437975 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 353/678] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:03 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:04.459714 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7c82dd93-dae8-4097-a4d8-a7856c4d2d00 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:04.460392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7c82dd93-dae8-4097-a4d8-a7856c4d2d00 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:04.466563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c82dd93-dae8-4097-a4d8-a7856c4d2d00 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:04.467007 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c82dd93-dae8-4097-a4d8-a7856c4d2d00 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:04.467759 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c82dd93-dae8-4097-a4d8-a7856c4d2d00 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:04.468191 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c82dd93-dae8-4097-a4d8-a7856c4d2d00 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:04.597088 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7c82dd93-dae8-4097-a4d8-a7856c4d2d00 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:04.604978 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7c82dd93-dae8-4097-a4d8-a7856c4d2d00 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.149956 Jul 28 09:18:04.605535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 326/679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:04 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:05.337470 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-7cdd3bdd-1b83-4bef-b1f1-d7e956b192bb req-d370f9c8-1c4a-444a-bf16-99ef67fed331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f77207-4c9e-4c6b-8948-d42f1f28c4aa", "tag": "433c3376-c310-4c2a-80fa-815d10d185aa"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:05.347474 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-7cdd3bdd-1b83-4bef-b1f1-d7e956b192bb req-d370f9c8-1c4a-444a-bf16-99ef67fed331 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:05.347870 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-7cdd3bdd-1b83-4bef-b1f1-d7e956b192bb req-d370f9c8-1c4a-444a-bf16-99ef67fed331 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:05.358513 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-7cdd3bdd-1b83-4bef-b1f1-d7e956b192bb req-d370f9c8-1c4a-444a-bf16-99ef67fed331 service nova] Creating event network-changed:433c3376-c310-4c2a-80fa-815d10d185aa for instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa on hv-cinder-85124 Jul 28 09:18:05.363331 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-7cdd3bdd-1b83-4bef-b1f1-d7e956b192bb req-d370f9c8-1c4a-444a-bf16-99ef67fed331 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030108 Jul 28 09:18:05.363893 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 354/680] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:05.626755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bd464f02-fb68-4d09-ab2a-1b2da24f1213 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:05.627448 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bd464f02-fb68-4d09-ab2a-1b2da24f1213 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:05.634649 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bd464f02-fb68-4d09-ab2a-1b2da24f1213 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:05.635102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bd464f02-fb68-4d09-ab2a-1b2da24f1213 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:05.635863 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bd464f02-fb68-4d09-ab2a-1b2da24f1213 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:05.636298 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bd464f02-fb68-4d09-ab2a-1b2da24f1213 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:05.843266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bd464f02-fb68-4d09-ab2a-1b2da24f1213 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:05.850969 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bd464f02-fb68-4d09-ab2a-1b2da24f1213 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.228159 Jul 28 09:18:05.851541 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 327/681] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:05 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:06.874532 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1ab1cc19-95f8-41a5-971c-773a4fd7195e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:06.875230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1ab1cc19-95f8-41a5-971c-773a4fd7195e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:06.881294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1ab1cc19-95f8-41a5-971c-773a4fd7195e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:06.881741 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1ab1cc19-95f8-41a5-971c-773a4fd7195e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:06.882537 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1ab1cc19-95f8-41a5-971c-773a4fd7195e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:06.882972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1ab1cc19-95f8-41a5-971c-773a4fd7195e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:07.015024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1ab1cc19-95f8-41a5-971c-773a4fd7195e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:07.022590 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1ab1cc19-95f8-41a5-971c-773a4fd7195e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1678 microversion: 2.1 time: 0.152815 Jul 28 09:18:07.023182 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 355/682] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:06 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:08.042962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d3657073-9527-48d1-a3cb-d7750b46ae6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:08.043563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d3657073-9527-48d1-a3cb-d7750b46ae6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:08.050223 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d3657073-9527-48d1-a3cb-d7750b46ae6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:08.050666 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d3657073-9527-48d1-a3cb-d7750b46ae6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:08.051417 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d3657073-9527-48d1-a3cb-d7750b46ae6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:08.051847 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d3657073-9527-48d1-a3cb-d7750b46ae6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:08.179460 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d3657073-9527-48d1-a3cb-d7750b46ae6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:08.186937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d3657073-9527-48d1-a3cb-d7750b46ae6a tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1655 microversion: 2.1 time: 0.147888 Jul 28 09:18:08.187494 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 328/683] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:08 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:08.207837 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-65d37da7-88ad-4963-927b-0cf5ac57ed2c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:08.215009 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-65d37da7-88ad-4963-927b-0cf5ac57ed2c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:08.215457 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-65d37da7-88ad-4963-927b-0cf5ac57ed2c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:08.236372 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-65d37da7-88ad-4963-927b-0cf5ac57ed2c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Going to try to start instance {{(pid=117864) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 09:18:08.277618 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-65d37da7-88ad-4963-927b-0cf5ac57ed2c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/action" status: 202 len: 0 microversion: 2.1 time: 0.073689 Jul 28 09:18:08.278295 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 356/684] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:18:08 2022] POST /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:18:08.286201 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-87043dbe-2b06-476d-9d69-5951b4bc5333 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:08.286890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-87043dbe-2b06-476d-9d69-5951b4bc5333 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:08.292872 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-87043dbe-2b06-476d-9d69-5951b4bc5333 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:08.293323 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-87043dbe-2b06-476d-9d69-5951b4bc5333 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:08.294112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-87043dbe-2b06-476d-9d69-5951b4bc5333 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:08.294548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-87043dbe-2b06-476d-9d69-5951b4bc5333 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:08.312786 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.425259 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-87043dbe-2b06-476d-9d69-5951b4bc5333 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:08.433223 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-87043dbe-2b06-476d-9d69-5951b4bc5333 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1664 microversion: 2.1 time: 0.150740 Jul 28 09:18:08.433736 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 329/685] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:08 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:09.457273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-58ac3e2c-65e4-499c-8fbf-62e5b675390c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:09.458005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-58ac3e2c-65e4-499c-8fbf-62e5b675390c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:09.464354 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58ac3e2c-65e4-499c-8fbf-62e5b675390c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:09.464803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58ac3e2c-65e4-499c-8fbf-62e5b675390c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:09.465566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58ac3e2c-65e4-499c-8fbf-62e5b675390c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:09.466036 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58ac3e2c-65e4-499c-8fbf-62e5b675390c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:09.607102 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-58ac3e2c-65e4-499c-8fbf-62e5b675390c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:09.617279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-58ac3e2c-65e4-499c-8fbf-62e5b675390c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1664 microversion: 2.1 time: 0.164856 Jul 28 09:18:09.618266 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 357/686] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:09 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:10.640158 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-599df1d4-81a4-49ee-b244-9e2c732583d8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:10.640698 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-599df1d4-81a4-49ee-b244-9e2c732583d8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:10.647331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-599df1d4-81a4-49ee-b244-9e2c732583d8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:10.647812 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-599df1d4-81a4-49ee-b244-9e2c732583d8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:10.648576 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-599df1d4-81a4-49ee-b244-9e2c732583d8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:10.649012 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-599df1d4-81a4-49ee-b244-9e2c732583d8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:10.775936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-599df1d4-81a4-49ee-b244-9e2c732583d8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:10.783344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-599df1d4-81a4-49ee-b244-9e2c732583d8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1668 microversion: 2.1 time: 0.147099 Jul 28 09:18:10.783904 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 330/687] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:10 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:26.504874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bff7f655-0bc2-4fc6-8dbc-eb8d3b5a00d5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:26.505430 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bff7f655-0bc2-4fc6-8dbc-eb8d3b5a00d5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:26.507556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=17 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.508330 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=80,nova_cell1:UPDATE=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.514747 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bff7f655-0bc2-4fc6-8dbc-eb8d3b5a00d5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:26.515226 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bff7f655-0bc2-4fc6-8dbc-eb8d3b5a00d5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:26.515999 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bff7f655-0bc2-4fc6-8dbc-eb8d3b5a00d5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:26.517057 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bff7f655-0bc2-4fc6-8dbc-eb8d3b5a00d5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:26.540757 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bff7f655-0bc2-4fc6-8dbc-eb8d3b5a00d5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3/ips" status: 200 len: 151 microversion: 2.1 time: 0.039861 Jul 28 09:18:26.541326 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 358/688] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:18:26 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:26.553872 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c3072c9-0124-4063-a7e3-83d86bd805d8"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:26.556398 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:26.561392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=31 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.562065 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=8 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.566209 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:26.566641 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:26.567409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:26.567884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:26.649389 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Invalid volume: volume 4c3072c9-0124-4063-a7e3-83d86bd805d8 is already attached to instances: a8bbe522-65b1-4925-9da8-8691bb25acdc Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: POST /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3/os-volume_attachments HTTP/1.1 Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 74 Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:18:26.651292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {"volumeAttachment": {"volumeId": "4c3072c9-0124-4063-a7e3-83d86bd805d8"}} Jul 28 09:18:26.652901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Invalid volume: volume 4c3072c9-0124-4063-a7e3-83d86bd805d8 is already attached to instances: a8bbe522-65b1-4925-9da8-8691bb25acdc Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'server_id': '886e113b-47d9-4760-bf0d-d5a2901b61f3', 'body': {'volumeAttachment': {'volumeId': '4c3072c9-0124-4063-a7e3-83d86bd805d8'}}} Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4c3072c9-0124-4063-a7e3-83d86bd805d8 is already attached to instances: a8bbe522-65b1-4925-9da8-8691bb25acdc Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:26.653796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4c3072c9-0124-4063-a7e3-83d86bd805d8 is already attached to instances: a8bbe522-65b1-4925-9da8-8691bb25acdc Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:26.655213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:18:26.656711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:18:26.656711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:18:26.656711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:18:26.656711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4c3072c9-0124-4063-a7e3-83d86bd805d8 is already attached to instances: a8bbe522-65b1-4925-9da8-8691bb25acdc Jul 28 09:18:26.656711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:26.656711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 400 to user: Invalid volume: volume 4c3072c9-0124-4063-a7e3-83d86bd805d8 is already attached to instances: a8bbe522-65b1-4925-9da8-8691bb25acdc {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:18:26.656711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6d7dea2c-3501-4e21-aae8-02befc8ed3a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103000 Jul 28 09:18:26.656711 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 331/689] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:18:26 2022] POST /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:18:26.661590 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3f0669b4-fbac-463c-a803-c71f30ab7627 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:26.662223 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3f0669b4-fbac-463c-a803-c71f30ab7627 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:26.668131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f0669b4-fbac-463c-a803-c71f30ab7627 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:26.668578 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f0669b4-fbac-463c-a803-c71f30ab7627 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:26.669367 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f0669b4-fbac-463c-a803-c71f30ab7627 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:26.669896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3f0669b4-fbac-463c-a803-c71f30ab7627 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:26.698304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3f0669b4-fbac-463c-a803-c71f30ab7627 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:18:26.771128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3f0669b4-fbac-463c-a803-c71f30ab7627 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 204 len: 0 microversion: 2.1 time: 0.113188 Jul 28 09:18:26.771937 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 359/690] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:18:26 2022] DELETE /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:26.780157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f173f749-f5ae-4a50-8fbb-b6c32b5b228d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:26.780763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f173f749-f5ae-4a50-8fbb-b6c32b5b228d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:26.786680 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f173f749-f5ae-4a50-8fbb-b6c32b5b228d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:26.787126 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f173f749-f5ae-4a50-8fbb-b6c32b5b228d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:26.787883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f173f749-f5ae-4a50-8fbb-b6c32b5b228d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:26.788318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f173f749-f5ae-4a50-8fbb-b6c32b5b228d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:26.924239 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f173f749-f5ae-4a50-8fbb-b6c32b5b228d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:26.931554 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f173f749-f5ae-4a50-8fbb-b6c32b5b228d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1683 microversion: 2.1 time: 0.155251 Jul 28 09:18:26.932121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 332/691] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:26 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:27.953110 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-666ed62a-901a-4afb-a85e-b2aa98ddd842 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:27.953811 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-666ed62a-901a-4afb-a85e-b2aa98ddd842 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:27.960528 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-666ed62a-901a-4afb-a85e-b2aa98ddd842 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:27.960975 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-666ed62a-901a-4afb-a85e-b2aa98ddd842 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:27.961737 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-666ed62a-901a-4afb-a85e-b2aa98ddd842 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:27.962200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-666ed62a-901a-4afb-a85e-b2aa98ddd842 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:28.090233 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-666ed62a-901a-4afb-a85e-b2aa98ddd842 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:28.097627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-666ed62a-901a-4afb-a85e-b2aa98ddd842 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1683 microversion: 2.1 time: 0.148714 Jul 28 09:18:28.098217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 360/692] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:27 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:29.120090 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d2a23dd3-ac67-432e-aa9f-c91d770c88ea tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:29.120691 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d2a23dd3-ac67-432e-aa9f-c91d770c88ea tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:29.127097 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2a23dd3-ac67-432e-aa9f-c91d770c88ea tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:29.127535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2a23dd3-ac67-432e-aa9f-c91d770c88ea tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:29.128290 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2a23dd3-ac67-432e-aa9f-c91d770c88ea tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:29.128718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2a23dd3-ac67-432e-aa9f-c91d770c88ea tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:29.380089 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d2a23dd3-ac67-432e-aa9f-c91d770c88ea tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:29.387760 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d2a23dd3-ac67-432e-aa9f-c91d770c88ea tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 200 len: 1683 microversion: 2.1 time: 0.272192 Jul 28 09:18:29.388352 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 333/693] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:29 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 1683 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:29.826354 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-70645648-c9cb-4eb9-9b28-9041171c0ef2 req-d8f599a6-130d-4109-92aa-b47cda39eb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886e113b-47d9-4760-bf0d-d5a2901b61f3", "name": "network-vif-deleted", "tag": "5f846baf-d511-4258-bded-99970e48af03"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:29.836596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-70645648-c9cb-4eb9-9b28-9041171c0ef2 req-d8f599a6-130d-4109-92aa-b47cda39eb25 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:29.837554 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-70645648-c9cb-4eb9-9b28-9041171c0ef2 req-d8f599a6-130d-4109-92aa-b47cda39eb25 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:29.849710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-70645648-c9cb-4eb9-9b28-9041171c0ef2 req-d8f599a6-130d-4109-92aa-b47cda39eb25 service nova] Creating event network-vif-deleted:5f846baf-d511-4258-bded-99970e48af03 for instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 on hv-cinder-85124 Jul 28 09:18:29.854663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-70645648-c9cb-4eb9-9b28-9041171c0ef2 req-d8f599a6-130d-4109-92aa-b47cda39eb25 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032539 Jul 28 09:18:29.855344 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 361/694] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:18:30.409758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:30.410573 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:30.417904 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:30.418437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:30.419280 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:30.419800 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:30.433790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 HTTP/1.1 Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:18:30.435511 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:18:30.436877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '886e113b-47d9-4760-bf0d-d5a2901b61f3'} Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:18:30.437618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:18:30.438866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:30.440219 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:18:30.444313 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-089479d4-435f-476f-b8c6-d3591f23a171 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 404 len: 111 microversion: 2.1 time: 0.031190 Jul 28 09:18:30.449895 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 334/695] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:30 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:18:30.459417 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-448090d1-f5db-4e43-97cb-d7050d53af2d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '.version_select at 0x7fd6c778ef70>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:30.480459 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-448090d1-f5db-4e43-97cb-d7050d53af2d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864685185" status: 202 len: 0 microversion: 2.1 time: 0.025030 Jul 28 09:18:30.481876 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 362/696] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 09:18:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864685185 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:18:31.219091 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1405d901-39a3-4988-8a99-8c86bb608c9c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:31.219581 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1405d901-39a3-4988-8a99-8c86bb608c9c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:31.225589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1405d901-39a3-4988-8a99-8c86bb608c9c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:31.226068 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1405d901-39a3-4988-8a99-8c86bb608c9c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:31.226831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1405d901-39a3-4988-8a99-8c86bb608c9c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:31.227268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1405d901-39a3-4988-8a99-8c86bb608c9c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:31.316906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-1405d901-39a3-4988-8a99-8c86bb608c9c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lazy-loading 'services' on Instance uuid a8bbe522-65b1-4925-9da8-8691bb25acdc {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:18:31.396443 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1405d901-39a3-4988-8a99-8c86bb608c9c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-volume_attachments/4c3072c9-0124-4063-a7e3-83d86bd805d8" status: 202 len: 0 microversion: 2.1 time: 0.180970 Jul 28 09:18:31.396964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 335/697] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:18:31 2022] DELETE /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-volume_attachments/4c3072c9-0124-4063-a7e3-83d86bd805d8 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:18:31.405864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd2449ba-226f-4dd9-a58f-84449bdde2a4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:31.408051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dd2449ba-226f-4dd9-a58f-84449bdde2a4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:31.415237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd2449ba-226f-4dd9-a58f-84449bdde2a4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:31.415711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd2449ba-226f-4dd9-a58f-84449bdde2a4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:31.417029 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd2449ba-226f-4dd9-a58f-84449bdde2a4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:31.417487 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd2449ba-226f-4dd9-a58f-84449bdde2a4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:31.447129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dd2449ba-226f-4dd9-a58f-84449bdde2a4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045759 Jul 28 09:18:31.448268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 363/698] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:18:31 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:32.461588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-df3bba09-d07b-4000-857a-a78576d38068 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:32.464627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-df3bba09-d07b-4000-857a-a78576d38068 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:32.471029 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df3bba09-d07b-4000-857a-a78576d38068 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:32.471500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df3bba09-d07b-4000-857a-a78576d38068 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:32.472255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df3bba09-d07b-4000-857a-a78576d38068 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:32.472685 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df3bba09-d07b-4000-857a-a78576d38068 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:32.503353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-df3bba09-d07b-4000-857a-a78576d38068 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046624 Jul 28 09:18:32.503910 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 336/699] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:18:32 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:18:32.564939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7a755553-fdcb-40f0-921c-6f9beafd8dd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:32.565428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7a755553-fdcb-40f0-921c-6f9beafd8dd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:32.571724 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a755553-fdcb-40f0-921c-6f9beafd8dd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:32.572253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a755553-fdcb-40f0-921c-6f9beafd8dd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:32.572917 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a755553-fdcb-40f0-921c-6f9beafd8dd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:32.573998 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a755553-fdcb-40f0-921c-6f9beafd8dd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:32.598567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7a755553-fdcb-40f0-921c-6f9beafd8dd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:18:32.677035 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7a755553-fdcb-40f0-921c-6f9beafd8dd9 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 204 len: 0 microversion: 2.1 time: 0.115371 Jul 28 09:18:32.677723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 364/700] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:18:32 2022] DELETE /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:32.686628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c230e013-460e-46df-ab5d-b65c46c1a12a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:32.687163 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c230e013-460e-46df-ab5d-b65c46c1a12a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:32.693052 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c230e013-460e-46df-ab5d-b65c46c1a12a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:32.693492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c230e013-460e-46df-ab5d-b65c46c1a12a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:32.694491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c230e013-460e-46df-ab5d-b65c46c1a12a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:32.694930 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c230e013-460e-46df-ab5d-b65c46c1a12a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:32.825366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c230e013-460e-46df-ab5d-b65c46c1a12a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:32.833026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c230e013-460e-46df-ab5d-b65c46c1a12a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1679 microversion: 2.1 time: 0.150980 Jul 28 09:18:32.833579 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 337/701] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:32 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:33.855446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ebcd275d-64fe-4788-9e27-b57f8dfd7967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:33.856137 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ebcd275d-64fe-4788-9e27-b57f8dfd7967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:33.862492 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebcd275d-64fe-4788-9e27-b57f8dfd7967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:33.862941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebcd275d-64fe-4788-9e27-b57f8dfd7967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:33.863694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebcd275d-64fe-4788-9e27-b57f8dfd7967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:33.864122 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebcd275d-64fe-4788-9e27-b57f8dfd7967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:34.099007 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ebcd275d-64fe-4788-9e27-b57f8dfd7967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:34.106354 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ebcd275d-64fe-4788-9e27-b57f8dfd7967 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1679 microversion: 2.1 time: 0.255105 Jul 28 09:18:34.106856 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 365/702] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:33 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:34.727889 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-ecc1082e-ae2b-4c80-8463-ac906daa3822 req-2fb30e9a-4373-4c19-b2ee-5293d7acdcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bbe522-65b1-4925-9da8-8691bb25acdc", "name": "network-vif-deleted", "tag": "083e115f-7d9f-46a4-a9c2-332b4c7553c4"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:34.740158 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-ecc1082e-ae2b-4c80-8463-ac906daa3822 req-2fb30e9a-4373-4c19-b2ee-5293d7acdcf0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:34.740676 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-ecc1082e-ae2b-4c80-8463-ac906daa3822 req-2fb30e9a-4373-4c19-b2ee-5293d7acdcf0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:34.752541 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-ecc1082e-ae2b-4c80-8463-ac906daa3822 req-2fb30e9a-4373-4c19-b2ee-5293d7acdcf0 service nova] Creating event network-vif-deleted:083e115f-7d9f-46a4-a9c2-332b4c7553c4 for instance a8bbe522-65b1-4925-9da8-8691bb25acdc on hv-cinder-85124 Jul 28 09:18:34.757327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-ecc1082e-ae2b-4c80-8463-ac906daa3822 req-2fb30e9a-4373-4c19-b2ee-5293d7acdcf0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 Jul 28 09:18:34.758615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 338/703] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:35.128113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:35.128711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:35.135204 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:35.136178 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:35.136939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:35.137369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:35.169987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:35.170426 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:35.170867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lazy-loading 'fault' on Instance uuid a8bbe522-65b1-4925-9da8-8691bb25acdc {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:18:35.214391 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:35.222032 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7018f5dd-4aec-407c-974e-f83f6df3a6bd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 200 len: 1330 microversion: 2.1 time: 0.097744 Jul 28 09:18:35.222755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 366/704] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:35 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:36.244674 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:36.245316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:36.251954 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:36.252403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:36.253157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:36.253594 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:36.268396 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc HTTP/1.1 Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:18:36.270015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:18:36.271440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'a8bbe522-65b1-4925-9da8-8691bb25acdc'} Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:18:36.272243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:18:36.273729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:36.275107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:18:36.275107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-52832bd2-8bec-4b93-992b-506e3bf5e7bf tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 404 len: 111 microversion: 2.1 time: 0.031497 Jul 28 09:18:36.275107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 339/705] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:36 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:18:36.280177 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-83dc8efa-81ad-4213-96d5-a2d56933f079 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '.version_select at 0x7fd6c7698b80>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:36.297430 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-83dc8efa-81ad-4213-96d5-a2d56933f079 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394752005" status: 202 len: 0 microversion: 2.1 time: 0.020974 Jul 28 09:18:36.298004 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 367/706] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 09:18:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394752005 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:18:36.911290 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-08437314-222e-4f2e-93cc-47a239b495d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: .version_select at 0x7fd6c777e160>, body: {"keypair": {"name": "tempest-keypair-1132369644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLwKygQnjk8MJgNdIbRxHjfkyjPz5FArlHB2RTTJI2YXatH5kDOtDhV38PO6qVX7jbYRBmG2BLv+EthZY5AVV0/ledS2pkkcpmhFzZeaNPk/HaMpmN8aMuzZKdSDHO8iQ=="}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:36.931747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-08437314-222e-4f2e-93cc-47a239b495d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for project c957cfe3391147daab9fc1e59b414a3e. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:18:36.935496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-08437314-222e-4f2e-93cc-47a239b495d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for user e0c1ed47784c46baa7ddc4abdfc54bbb and project c957cfe3391147daab9fc1e59b414a3e. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:18:36.971339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-08437314-222e-4f2e-93cc-47a239b495d4 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063925 Jul 28 09:18:36.971940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 340/707] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:18:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:38.175054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1577455211", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a25c70eb-0093-412d-853c-bc88149a664e"}], "security_groups": [{"name": "tempest-securitygroup--1225000709"}], "key_name": "tempest-keypair-1132369644", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:38.274460 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] validate_networks() for [('a25c70eb-0093-412d-853c-bc88149a664e', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:18:38.706655 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7610ecd0-ed10-43e5-9f2b-6da010857ab7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:38.707209 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7610ecd0-ed10-43e5-9f2b-6da010857ab7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:38.713279 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7610ecd0-ed10-43e5-9f2b-6da010857ab7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:38.713756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7610ecd0-ed10-43e5-9f2b-6da010857ab7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:38.715272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7610ecd0-ed10-43e5-9f2b-6da010857ab7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:38.715759 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7610ecd0-ed10-43e5-9f2b-6da010857ab7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:38.744304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7610ecd0-ed10-43e5-9f2b-6da010857ab7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments/18e3c092-370f-4d19-aaab-7fc87c647a4f" status: 200 len: 194 microversion: 2.20 time: 0.042682 Jul 28 09:18:38.744886 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 341/708] 10.222.0.48 () {60 vars in 1454 bytes} [Thu Jul 28 09:18:38 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments/18e3c092-370f-4d19-aaab-7fc87c647a4f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:18:38.811198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-acaafb0a-65b8-44e9-8226-708b996d81ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:38.811692 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-acaafb0a-65b8-44e9-8226-708b996d81ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:38.817731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-acaafb0a-65b8-44e9-8226-708b996d81ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:38.818210 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-acaafb0a-65b8-44e9-8226-708b996d81ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:38.818968 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-acaafb0a-65b8-44e9-8226-708b996d81ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:38.819404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-acaafb0a-65b8-44e9-8226-708b996d81ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:38.860171 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:18:38.860667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:18:38.861222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:18:38.861716 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:18:38.862384 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:18:38.871155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:38.871674 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:38.872536 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:38.873038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:38.889937 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for project c957cfe3391147daab9fc1e59b414a3e. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:18:38.894093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for user e0c1ed47784c46baa7ddc4abdfc54bbb and project c957cfe3391147daab9fc1e59b414a3e. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:18:38.899852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-acaafb0a-65b8-44e9-8226-708b996d81ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lazy-loading 'services' on Instance uuid 145d502e-eb34-435a-8b8c-2ea6264d1506 {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:18:38.906616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:18:38.909076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:18:38.955675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2b09aa33-e487-4762-ad01-9eb0c038e585 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.785502 Jul 28 09:18:38.956794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 368/709] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:18:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:18:38.970163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-64840994-018c-4403-8cdf-38d93a39a35a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:38.972198 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-64840994-018c-4403-8cdf-38d93a39a35a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:38.983126 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-acaafb0a-65b8-44e9-8226-708b996d81ee tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments/18e3c092-370f-4d19-aaab-7fc87c647a4f" status: 202 len: 0 microversion: 2.20 time: 0.175790 Jul 28 09:18:38.984752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 342/710] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Jul 28 09:18:38 2022] DELETE /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments/18e3c092-370f-4d19-aaab-7fc87c647a4f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:38.993371 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-475a0dae-b9a7-4869-80f1-95ce468fc073 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:38.995852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-475a0dae-b9a7-4869-80f1-95ce468fc073 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:39.003717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-475a0dae-b9a7-4869-80f1-95ce468fc073 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:39.004273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-475a0dae-b9a7-4869-80f1-95ce468fc073 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:39.005057 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-475a0dae-b9a7-4869-80f1-95ce468fc073 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:39.005485 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-475a0dae-b9a7-4869-80f1-95ce468fc073 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:39.039150 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-475a0dae-b9a7-4869-80f1-95ce468fc073 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050101 Jul 28 09:18:39.039729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 343/711] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 09:18:38 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:18:39.041438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-64840994-018c-4403-8cdf-38d93a39a35a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:39.049199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-64840994-018c-4403-8cdf-38d93a39a35a tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1242 microversion: 2.1 time: 0.085882 Jul 28 09:18:39.049761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 369/712] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:38 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:40.050872 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e7a9e97e-1847-4d5d-a689-407aaee964af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:40.052993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e7a9e97e-1847-4d5d-a689-407aaee964af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:40.060017 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e7a9e97e-1847-4d5d-a689-407aaee964af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:40.060466 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e7a9e97e-1847-4d5d-a689-407aaee964af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:40.061250 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e7a9e97e-1847-4d5d-a689-407aaee964af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:40.061685 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e7a9e97e-1847-4d5d-a689-407aaee964af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:40.070362 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f016d829-c205-4488-9455-3e15e5146925 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:40.071085 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f016d829-c205-4488-9455-3e15e5146925 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:40.078631 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f016d829-c205-4488-9455-3e15e5146925 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:40.079660 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f016d829-c205-4488-9455-3e15e5146925 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:40.080087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f016d829-c205-4488-9455-3e15e5146925 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:40.080557 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f016d829-c205-4488-9455-3e15e5146925 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:40.092623 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e7a9e97e-1847-4d5d-a689-407aaee964af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045663 Jul 28 09:18:40.093384 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 344/713] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 09:18:40 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:18:40.150046 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f016d829-c205-4488-9455-3e15e5146925 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:40.158154 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f016d829-c205-4488-9455-3e15e5146925 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1294 microversion: 2.1 time: 0.091399 Jul 28 09:18:40.158720 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 370/714] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:40 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:41.104966 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-150e4583-cb82-4119-b033-f4f0324ea00e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:41.107283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-150e4583-cb82-4119-b033-f4f0324ea00e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:41.114101 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-150e4583-cb82-4119-b033-f4f0324ea00e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.114692 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-150e4583-cb82-4119-b033-f4f0324ea00e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.115576 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-150e4583-cb82-4119-b033-f4f0324ea00e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.116118 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-150e4583-cb82-4119-b033-f4f0324ea00e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.148633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-150e4583-cb82-4119-b033-f4f0324ea00e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047765 Jul 28 09:18:41.149333 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 345/715] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 09:18:41 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:41.180856 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b2342918-0557-45b5-ac40-795b3309033f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:41.182087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b2342918-0557-45b5-ac40-795b3309033f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:41.190502 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b2342918-0557-45b5-ac40-795b3309033f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.191143 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b2342918-0557-45b5-ac40-795b3309033f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.191923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b2342918-0557-45b5-ac40-795b3309033f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.192407 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b2342918-0557-45b5-ac40-795b3309033f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.220410 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-88fd3ec5-9ef6-45ca-8faa-809386496eba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:41.221194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-88fd3ec5-9ef6-45ca-8faa-809386496eba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:41.227406 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-88fd3ec5-9ef6-45ca-8faa-809386496eba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.228090 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-88fd3ec5-9ef6-45ca-8faa-809386496eba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.229028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-88fd3ec5-9ef6-45ca-8faa-809386496eba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.229614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-88fd3ec5-9ef6-45ca-8faa-809386496eba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.255315 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-88fd3ec5-9ef6-45ca-8faa-809386496eba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:18:41.332470 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-88fd3ec5-9ef6-45ca-8faa-809386496eba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 204 len: 0 microversion: 2.20 time: 0.115589 Jul 28 09:18:41.333340 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 346/716] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 09:18:41 2022] DELETE /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:18:41.348736 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:41.349585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:41.356733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.357500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.358752 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.359535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.380199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:41.523195 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b2342918-0557-45b5-ac40-795b3309033f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:41.530474 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b2342918-0557-45b5-ac40-795b3309033f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.353768 Jul 28 09:18:41.531038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 371/717] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:41 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:41.595390 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:41.603451 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:41.605196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:41.606623 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-996b126f-d6d4-4148-85b6-1439c93067be tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.267195 Jul 28 09:18:41.607363 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 347/718] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:41 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:18:41.895302 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-a24cac53-acb2-40fd-8078-a7c5fbc7b22d req-cc2a3fb3-f4a5-4122-b3de-ab26f5dad29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f89173-0824-45dd-bdf5-c5af808a7dd2", "tag": "642c71da-4349-4b9a-a9fe-eda73d9d6417"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:41.904679 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-a24cac53-acb2-40fd-8078-a7c5fbc7b22d req-cc2a3fb3-f4a5-4122-b3de-ab26f5dad29b service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:41.905124 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-a24cac53-acb2-40fd-8078-a7c5fbc7b22d req-cc2a3fb3-f4a5-4122-b3de-ab26f5dad29b service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:41.922977 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-a24cac53-acb2-40fd-8078-a7c5fbc7b22d req-cc2a3fb3-f4a5-4122-b3de-ab26f5dad29b service nova] Creating event network-changed:642c71da-4349-4b9a-a9fe-eda73d9d6417 for instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 on hv-cinder-85124 Jul 28 09:18:41.928689 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-a24cac53-acb2-40fd-8078-a7c5fbc7b22d req-cc2a3fb3-f4a5-4122-b3de-ab26f5dad29b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036820 Jul 28 09:18:41.929491 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 372/719] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:42.551883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cfd1173b-2eee-40ee-8495-0e435251e9a5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:42.552490 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cfd1173b-2eee-40ee-8495-0e435251e9a5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:42.558879 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cfd1173b-2eee-40ee-8495-0e435251e9a5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:42.559326 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cfd1173b-2eee-40ee-8495-0e435251e9a5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:42.560074 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cfd1173b-2eee-40ee-8495-0e435251e9a5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:42.560506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cfd1173b-2eee-40ee-8495-0e435251e9a5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:42.631466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:42.632181 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:42.638942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:42.639393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:42.640157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:42.640592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:42.696681 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cfd1173b-2eee-40ee-8495-0e435251e9a5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:42.704845 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cfd1173b-2eee-40ee-8495-0e435251e9a5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.156537 Jul 28 09:18:42.705409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 348/720] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:42 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:42.779685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:42.787858 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:42.789464 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:42.790680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-134eaf30-87ff-4753-9534-1ee66ab1b95b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.164030 Jul 28 09:18:42.791217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 373/721] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:42 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:18:43.726368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8473040c-87ce-4c64-bc7d-ba48e21f7b50 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:43.727186 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8473040c-87ce-4c64-bc7d-ba48e21f7b50 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:43.734325 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8473040c-87ce-4c64-bc7d-ba48e21f7b50 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:43.734772 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8473040c-87ce-4c64-bc7d-ba48e21f7b50 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:43.735534 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8473040c-87ce-4c64-bc7d-ba48e21f7b50 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:43.735965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8473040c-87ce-4c64-bc7d-ba48e21f7b50 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:43.812751 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:43.813400 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:43.819578 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:43.820032 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:43.820804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:43.821243 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:44.132537 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8473040c-87ce-4c64-bc7d-ba48e21f7b50 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:44.140475 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8473040c-87ce-4c64-bc7d-ba48e21f7b50 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.417950 Jul 28 09:18:44.141050 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 349/722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:43 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:44.202693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:44.210801 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:44.212305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:44.214096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a68cea03-7972-4577-a7a4-b418b5944255 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1722 microversion: 2.20 time: 0.405279 Jul 28 09:18:44.215264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 374/723] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:43 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:18:44.942032 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-25aeda03-574d-49e3-a647-6286574a212b req-84d2718e-cc3e-4aea-b78d-74530bf369e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145d502e-eb34-435a-8b8c-2ea6264d1506", "name": "network-vif-deleted", "tag": "51927101-a0e7-4577-83b1-566bb606eeb1"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:44.952176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-25aeda03-574d-49e3-a647-6286574a212b req-84d2718e-cc3e-4aea-b78d-74530bf369e5 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:44.953177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-25aeda03-574d-49e3-a647-6286574a212b req-84d2718e-cc3e-4aea-b78d-74530bf369e5 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:44.963875 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-25aeda03-574d-49e3-a647-6286574a212b req-84d2718e-cc3e-4aea-b78d-74530bf369e5 service nova] Creating event network-vif-deleted:51927101-a0e7-4577-83b1-566bb606eeb1 for instance 145d502e-eb34-435a-8b8c-2ea6264d1506 on hv-cinder-85124 Jul 28 09:18:44.968861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-25aeda03-574d-49e3-a647-6286574a212b req-84d2718e-cc3e-4aea-b78d-74530bf369e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030609 Jul 28 09:18:44.969446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 350/724] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:45.162150 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b1480302-0667-4233-bc25-f39521026027 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:45.162761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b1480302-0667-4233-bc25-f39521026027 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:45.169437 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1480302-0667-4233-bc25-f39521026027 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:45.169912 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1480302-0667-4233-bc25-f39521026027 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:45.170695 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1480302-0667-4233-bc25-f39521026027 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:45.171112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1480302-0667-4233-bc25-f39521026027 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:45.239077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:45.239969 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:45.246401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:45.246967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:45.247840 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:45.248379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:45.327305 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:45.331950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b1480302-0667-4233-bc25-f39521026027 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:45.336268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:45.337926 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:45.339778 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8d79f414-1b96-4433-af75-1e019a7d2041 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1654 microversion: 2.20 time: 0.104640 Jul 28 09:18:45.339904 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b1480302-0667-4233-bc25-f39521026027 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.180940 Jul 28 09:18:45.340589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 375/725] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:45 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:45.350492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 351/726] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:45 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1654 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:18:46.360939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0ab2570a-6d70-417d-8826-4c945d44247f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:46.361551 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0ab2570a-6d70-417d-8826-4c945d44247f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:46.362929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:46.363532 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:46.368164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ab2570a-6d70-417d-8826-4c945d44247f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:46.368614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ab2570a-6d70-417d-8826-4c945d44247f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:46.369379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ab2570a-6d70-417d-8826-4c945d44247f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:46.369813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ab2570a-6d70-417d-8826-4c945d44247f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:46.369975 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:46.371068 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:46.371900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:46.372334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:46.374400 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:46.458316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:46.466343 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:46.467828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:46.468985 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-aa71fa97-1a0d-44f7-97fa-5330b3269e70 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 200 len: 1654 microversion: 2.20 time: 0.109915 Jul 28 09:18:46.474124 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 352/727] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:46 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 1654 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:18:46.522278 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0ab2570a-6d70-417d-8826-4c945d44247f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:46.529780 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0ab2570a-6d70-417d-8826-4c945d44247f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.172688 Jul 28 09:18:46.530369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 376/728] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:46 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:47.491741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:47.492337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:47.494403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=4 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:47.500746 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:47.501194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:47.501987 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:47.502422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:47.516272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] HTTP exception thrown: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Request method failure captured: Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 HTTP/1.1 Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLBcBBsNPfKHFauhH-ovzSZnFi5Aja5CbhFTPUdJPw7Nno6Lt5J6ROL2LCIeEXPVmv8rpSqhtmXhLNbrvr_O5dY05kUPQ-Sr4wAGFOGHNZ3ixlAcT3hJZQpS6nWzd0Hn06tYSBdz0TqVjntf9OOauN2cQKin-TINVPjpmD-U9Gtd50 Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:18:47.517935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e862416d3ca4d019cd0dd62f439038c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}] Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: a6f5e471a7ac4218a35ffe1840d91575 Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:18:47.519497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '145d502e-eb34-435a-8b8c-2ea6264d1506'} Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:18:47.520419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:18:47.521758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:18:47.523057 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Returning 404 to user: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:18:47.523057 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9725eadb-25db-4120-b0c8-43bb7b3b51a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 404 len: 111 microversion: 2.20 time: 0.031515 Jul 28 09:18:47.523057 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 353/729] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:47 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:18:47.528284 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-db1a3e97-1c60-4019-b70e-2c2e3aab055a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '.version_select at 0x7fd6c76989d0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:47.546548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-db1a3e97-1c60-4019-b70e-2c2e3aab055a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-828896869" status: 204 len: 0 microversion: 2.20 time: 0.022137 Jul 28 09:18:47.547274 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 377/730] 10.222.0.48 () {60 vars in 1259 bytes} [Thu Jul 28 09:18:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-828896869 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:18:47.551140 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a06178b3-08f2-4bd9-bd4f-5007cccea8c0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:47.551249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a06178b3-08f2-4bd9-bd4f-5007cccea8c0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:47.557201 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a06178b3-08f2-4bd9-bd4f-5007cccea8c0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:47.557651 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a06178b3-08f2-4bd9-bd4f-5007cccea8c0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:47.558948 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a06178b3-08f2-4bd9-bd4f-5007cccea8c0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:47.559383 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a06178b3-08f2-4bd9-bd4f-5007cccea8c0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:47.750759 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a06178b3-08f2-4bd9-bd4f-5007cccea8c0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:47.759064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a06178b3-08f2-4bd9-bd4f-5007cccea8c0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.212110 Jul 28 09:18:47.759771 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 354/731] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:47 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:48.244106 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-23fc4104-6947-4e0c-84a6-a8b00cfdf5cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'create', calling method: .version_select at 0x7fd6c7677ca0>, body: {"keypair": {"name": "tempest-keypair-156990400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgeUJZm3EuQd9NbpQX9zoDyRvbXD3Dn42NA7pTUzLeDQGQqJ+mPBtS3Lt4nFcupqvw8wUNtBCxCCuRoSilbJyu+jMbg0o8j8A0ILPeZec0KXQqcjjaib3bL9k96nLqJFQ=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:48.259453 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-23fc4104-6947-4e0c-84a6-a8b00cfdf5cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Getting quotas for project 6e862416d3ca4d019cd0dd62f439038c. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:18:48.263238 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-23fc4104-6947-4e0c-84a6-a8b00cfdf5cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Getting quotas for user a6f5e471a7ac4218a35ffe1840d91575 and project 6e862416d3ca4d019cd0dd62f439038c. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:18:48.284179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-23fc4104-6947-4e0c-84a6-a8b00cfdf5cc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.043954 Jul 28 09:18:48.284748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 378/732] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 09:18:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 09:18:48.780660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8fd0a50b-f452-4395-84d5-3a05e63e95a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:48.781271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8fd0a50b-f452-4395-84d5-3a05e63e95a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:48.787658 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8fd0a50b-f452-4395-84d5-3a05e63e95a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:48.788103 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8fd0a50b-f452-4395-84d5-3a05e63e95a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:48.788928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8fd0a50b-f452-4395-84d5-3a05e63e95a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:48.789496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8fd0a50b-f452-4395-84d5-3a05e63e95a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:48.988169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8fd0a50b-f452-4395-84d5-3a05e63e95a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:48.995581 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8fd0a50b-f452-4395-84d5-3a05e63e95a0 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.218736 Jul 28 09:18:48.996215 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 355/733] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:48 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:49.626372 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1394754818", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62ef4833-ede7-4ed1-81d0-684613a04084"}], "security_groups": [{"name": "tempest-securitygroup--546655686"}], "key_name": "tempest-keypair-156990400", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:49.634686 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:49.741253 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] validate_networks() for [('62ef4833-ede7-4ed1-81d0-684613a04084', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:18:50.018012 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2d07e5ee-6084-41f0-8b74-cb51025f2cba tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:50.018851 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2d07e5ee-6084-41f0-8b74-cb51025f2cba tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:50.025136 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2d07e5ee-6084-41f0-8b74-cb51025f2cba tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:50.025672 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2d07e5ee-6084-41f0-8b74-cb51025f2cba tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:50.026541 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2d07e5ee-6084-41f0-8b74-cb51025f2cba tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:50.027554 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2d07e5ee-6084-41f0-8b74-cb51025f2cba tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:50.166063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:18:50.166556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:18:50.167099 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:18:50.167571 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:18:50.167986 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:18:50.177341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:50.177785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:50.178620 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:50.179045 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:50.188382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2d07e5ee-6084-41f0-8b74-cb51025f2cba tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:50.195603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Getting quotas for project 6e862416d3ca4d019cd0dd62f439038c. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:18:50.195802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2d07e5ee-6084-41f0-8b74-cb51025f2cba tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.182107 Jul 28 09:18:50.196373 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 356/734] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:50 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:50.197781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:50.202365 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Getting quotas for user a6f5e471a7ac4218a35ffe1840d91575 and project 6e862416d3ca4d019cd0dd62f439038c. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:18:50.215452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:18:50.217719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:18:50.263332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5187cab1-6378-48c1-b1f2-3797064feaf1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.641178 Jul 28 09:18:50.263899 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 379/735] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 09:18:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 09:18:50.274928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7a97f1bb-4f30-4a98-aef4-e45bccc19918 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:50.275531 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7a97f1bb-4f30-4a98-aef4-e45bccc19918 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:50.329825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7a97f1bb-4f30-4a98-aef4-e45bccc19918 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:50.338547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7a97f1bb-4f30-4a98-aef4-e45bccc19918 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:50.340079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7a97f1bb-4f30-4a98-aef4-e45bccc19918 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:50.342027 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7a97f1bb-4f30-4a98-aef4-e45bccc19918 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1281 microversion: 2.20 time: 0.071040 Jul 28 09:18:50.342937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 357/736] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:50 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:18:50.728702 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-e6354b01-e3c9-4b9c-86b8-43ea72119902 req-3173cd60-4959-4b8c-b2e4-dd69ff7f725d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f89173-0824-45dd-bdf5-c5af808a7dd2", "name": "network-vif-plugged", "status": "completed", "tag": "642c71da-4349-4b9a-a9fe-eda73d9d6417"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:50.740311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-e6354b01-e3c9-4b9c-86b8-43ea72119902 req-3173cd60-4959-4b8c-b2e4-dd69ff7f725d service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:50.741129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-e6354b01-e3c9-4b9c-86b8-43ea72119902 req-3173cd60-4959-4b8c-b2e4-dd69ff7f725d service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:50.757997 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-e6354b01-e3c9-4b9c-86b8-43ea72119902 req-3173cd60-4959-4b8c-b2e4-dd69ff7f725d service nova] Creating event network-vif-plugged:642c71da-4349-4b9a-a9fe-eda73d9d6417 for instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 on hv-cinder-85124 Jul 28 09:18:50.763861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-e6354b01-e3c9-4b9c-86b8-43ea72119902 req-3173cd60-4959-4b8c-b2e4-dd69ff7f725d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039524 Jul 28 09:18:50.764453 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 380/737] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:51.218058 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dcd71117-aa3b-4d4a-9f6b-0cf680c27f8b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:51.218742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dcd71117-aa3b-4d4a-9f6b-0cf680c27f8b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:51.225650 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dcd71117-aa3b-4d4a-9f6b-0cf680c27f8b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:51.226123 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dcd71117-aa3b-4d4a-9f6b-0cf680c27f8b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:51.226980 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dcd71117-aa3b-4d4a-9f6b-0cf680c27f8b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:51.227416 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dcd71117-aa3b-4d4a-9f6b-0cf680c27f8b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:51.364838 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:51.365542 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:51.367043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-dcd71117-aa3b-4d4a-9f6b-0cf680c27f8b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:51.371935 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:51.372386 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:51.373155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:51.373589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:51.374497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dcd71117-aa3b-4d4a-9f6b-0cf680c27f8b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.161211 Jul 28 09:18:51.375070 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 358/738] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:51 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:51.434857 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:51.442758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:51.444185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:51.445273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c7ce1507-49d9-4bf7-8f14-4c318b5b20a4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1341 microversion: 2.20 time: 0.084856 Jul 28 09:18:51.445826 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 381/739] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:51 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1341 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:18:52.395720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d124b6c9-96fd-4231-9f76-44fb21dd96f7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:52.396828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d124b6c9-96fd-4231-9f76-44fb21dd96f7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:52.403751 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d124b6c9-96fd-4231-9f76-44fb21dd96f7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:52.404202 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d124b6c9-96fd-4231-9f76-44fb21dd96f7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:52.405104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d124b6c9-96fd-4231-9f76-44fb21dd96f7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:52.405547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d124b6c9-96fd-4231-9f76-44fb21dd96f7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:52.469220 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:52.469767 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:52.476287 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:52.476739 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:52.477523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:52.477995 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:52.566989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:52.575755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:52.577276 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:52.578420 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-86917b38-2245-4f58-bffa-a40f4270ccbf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1339 microversion: 2.20 time: 0.113155 Jul 28 09:18:52.579004 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 382/740] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:52 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:18:52.603143 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d124b6c9-96fd-4231-9f76-44fb21dd96f7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:52.610508 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d124b6c9-96fd-4231-9f76-44fb21dd96f7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1368 microversion: 2.1 time: 0.219030 Jul 28 09:18:52.611069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 359/741] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:52 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:53.601033 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:53.601667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:53.611295 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:53.611743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:53.612510 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:53.612945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:53.632588 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6f4ca5df-7e85-4fe0-b354-cbc6b354c2a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:53.633248 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6f4ca5df-7e85-4fe0-b354-cbc6b354c2a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:53.645040 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6f4ca5df-7e85-4fe0-b354-cbc6b354c2a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:53.645754 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6f4ca5df-7e85-4fe0-b354-cbc6b354c2a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:53.646762 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6f4ca5df-7e85-4fe0-b354-cbc6b354c2a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:53.647369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6f4ca5df-7e85-4fe0-b354-cbc6b354c2a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:53.868184 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:53.876594 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:53.878119 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:53.879231 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a4c4cf7c-8f7e-4d38-b3f2-5ffdfa9dd0bf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1406 microversion: 2.20 time: 0.282084 Jul 28 09:18:53.879797 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 383/742] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:53 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:18:53.903236 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6f4ca5df-7e85-4fe0-b354-cbc6b354c2a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:53.910595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6f4ca5df-7e85-4fe0-b354-cbc6b354c2a2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1559 microversion: 2.1 time: 0.282449 Jul 28 09:18:53.911165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 360/743] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:18:53 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1559 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:53.931546 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-57ff48b3-a61b-460d-abba-fb08f142f286 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:53.932048 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-57ff48b3-a61b-460d-abba-fb08f142f286 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:53.938572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-57ff48b3-a61b-460d-abba-fb08f142f286 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:53.939025 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-57ff48b3-a61b-460d-abba-fb08f142f286 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:53.939791 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-57ff48b3-a61b-460d-abba-fb08f142f286 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:53.940227 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-57ff48b3-a61b-460d-abba-fb08f142f286 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:53.989108 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-a1ccfb2c-aacb-44ed-866d-b651fe5442e6 req-24282ec5-8973-4e7e-975a-1feff1a4ca20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf9f15d-39b9-4bd4-959f-0406b46dd02d", "tag": "760da6e1-e95d-4104-b4c2-bc4781aafac6"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:54.001581 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-a1ccfb2c-aacb-44ed-866d-b651fe5442e6 req-24282ec5-8973-4e7e-975a-1feff1a4ca20 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:54.002438 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-a1ccfb2c-aacb-44ed-866d-b651fe5442e6 req-24282ec5-8973-4e7e-975a-1feff1a4ca20 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:54.027372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-a1ccfb2c-aacb-44ed-866d-b651fe5442e6 req-24282ec5-8973-4e7e-975a-1feff1a4ca20 service nova] Creating event network-changed:760da6e1-e95d-4104-b4c2-bc4781aafac6 for instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d on hv-cinder-85124 Jul 28 09:18:54.032991 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-a1ccfb2c-aacb-44ed-866d-b651fe5442e6 req-24282ec5-8973-4e7e-975a-1feff1a4ca20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047516 Jul 28 09:18:54.033868 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 361/744] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:18:54.094506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-57ff48b3-a61b-460d-abba-fb08f142f286 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166770 Jul 28 09:18:54.095989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 384/745] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 09:18:53 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:54.901682 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:54.902481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:54.908803 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:54.909253 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:54.910048 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:54.910482 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:55.164959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:55.173683 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:55.175205 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:55.176305 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ed20dc80-a52d-465f-9c2e-f02227566947 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1406 microversion: 2.20 time: 0.279508 Jul 28 09:18:55.176859 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 362/746] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:54 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:18:56.053640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-5ed50c9e-577a-4d97-96ed-3ab1a250e4c7 req-e9dce506-677d-45ee-b4a0-2148163541a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30f89173-0824-45dd-bdf5-c5af808a7dd2", "tag": "642c71da-4349-4b9a-a9fe-eda73d9d6417"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:56.063058 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-5ed50c9e-577a-4d97-96ed-3ab1a250e4c7 req-e9dce506-677d-45ee-b4a0-2148163541a7 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:56.063506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-5ed50c9e-577a-4d97-96ed-3ab1a250e4c7 req-e9dce506-677d-45ee-b4a0-2148163541a7 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:56.074968 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-5ed50c9e-577a-4d97-96ed-3ab1a250e4c7 req-e9dce506-677d-45ee-b4a0-2148163541a7 service nova] Creating event network-changed:642c71da-4349-4b9a-a9fe-eda73d9d6417 for instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 on hv-cinder-85124 Jul 28 09:18:56.080251 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-5ed50c9e-577a-4d97-96ed-3ab1a250e4c7 req-e9dce506-677d-45ee-b4a0-2148163541a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030629 Jul 28 09:18:56.080838 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 385/747] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:18:56.200014 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:56.200615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:56.207347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:56.207791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:56.208547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:56.208980 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:56.349656 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:56.358073 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:56.359884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:56.361062 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9e4fd388-31bf-41c9-b97a-33de2c6be6aa tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1406 microversion: 2.20 time: 0.165432 Jul 28 09:18:56.361694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 363/748] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:56 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:18:57.384420 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:57.385213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:57.393686 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:57.394502 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:57.396277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:57.396734 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:57.701687 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:57.709882 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:57.711381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:57.712486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fd4618d9-eb5c-462e-8670-1b96fb50f068 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1406 microversion: 2.20 time: 0.332330 Jul 28 09:18:57.713046 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 386/749] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:57 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:18:58.736460 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:58.736967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:58.739486 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:58.745734 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:58.746208 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:58.746977 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:58.747414 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:58.875060 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:58.882841 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:58.884331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:18:58.885420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8ae76c8e-fb6b-4a2d-a82d-fe0f48f4c57b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1406 microversion: 2.20 time: 0.152905 Jul 28 09:18:58.886038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 364/750] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:58 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:18:59.907612 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:59.908175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:18:59.914640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:59.915093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:18:59.915855 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:18:59.916292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:00.041770 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:00.050102 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:00.051600 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:00.052694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dcd8f30e-6a7a-4cc7-82d8-efa173477ccb tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1406 microversion: 2.20 time: 0.149030 Jul 28 09:19:00.053248 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 387/751] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:18:59 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:00.697269 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-6aa51a7b-ab27-4dc0-b1b1-4c622f61760a req-98ee3ce9-e6dc-4ec7-a16f-f210d1530457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf9f15d-39b9-4bd4-959f-0406b46dd02d", "name": "network-vif-plugged", "status": "completed", "tag": "760da6e1-e95d-4104-b4c2-bc4781aafac6"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:00.703191 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:00.709633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-6aa51a7b-ab27-4dc0-b1b1-4c622f61760a req-98ee3ce9-e6dc-4ec7-a16f-f210d1530457 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:00.710184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-6aa51a7b-ab27-4dc0-b1b1-4c622f61760a req-98ee3ce9-e6dc-4ec7-a16f-f210d1530457 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:00.721967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-6aa51a7b-ab27-4dc0-b1b1-4c622f61760a req-98ee3ce9-e6dc-4ec7-a16f-f210d1530457 service nova] Creating event network-vif-plugged:760da6e1-e95d-4104-b4c2-bc4781aafac6 for instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d on hv-cinder-85124 Jul 28 09:19:00.726921 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-6aa51a7b-ab27-4dc0-b1b1-4c622f61760a req-98ee3ce9-e6dc-4ec7-a16f-f210d1530457 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Jul 28 09:19:00.727873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 365/752] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:01.075763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:01.076280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:01.078311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:01.079150 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=18 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:01.085682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:01.086153 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:01.086920 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:01.087352 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:01.212592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:01.220329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:01.222209 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:01.223292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-22cf7367-20d9-44d6-8159-2af127290214 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1406 microversion: 2.20 time: 0.152154 Jul 28 09:19:01.223845 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 388/753] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:19:01 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:02.246615 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:02.247245 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:02.253320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:02.253762 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:02.254542 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:02.254973 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:02.387561 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:02.395443 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:02.396958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:02.398090 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e3f45880-b534-42da-aa09-d881695539cd tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1406 microversion: 2.20 time: 0.156285 Jul 28 09:19:02.398649 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 366/754] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:19:02 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:03.421651 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:03.422293 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:03.428776 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:03.429229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:03.430027 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:03.430461 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:03.562961 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:03.570749 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:03.572239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:03.573933 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-98cce43c-e2a0-4e9a-8961-21c4860da06a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1598 microversion: 2.20 time: 0.156210 Jul 28 09:19:03.574527 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 389/755] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:19:03 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:03.596192 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9cda5c39-2ef4-4291-bda9-22f0ab3ca90e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:03.596693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9cda5c39-2ef4-4291-bda9-22f0ab3ca90e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:03.602798 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9cda5c39-2ef4-4291-bda9-22f0ab3ca90e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:03.603248 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9cda5c39-2ef4-4291-bda9-22f0ab3ca90e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:03.604003 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9cda5c39-2ef4-4291-bda9-22f0ab3ca90e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:03.604439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9cda5c39-2ef4-4291-bda9-22f0ab3ca90e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:03.678768 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9cda5c39-2ef4-4291-bda9-22f0ab3ca90e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086345 Jul 28 09:19:03.679366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 367/756] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 09:19:03 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:04.583906 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-ef4ac038-c919-4f79-b296-00fc3cb2da16 req-585c3ed4-3a2b-4400-9eee-9ae75181f999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf9f15d-39b9-4bd4-959f-0406b46dd02d", "tag": "760da6e1-e95d-4104-b4c2-bc4781aafac6"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:04.594093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ef4ac038-c919-4f79-b296-00fc3cb2da16 req-585c3ed4-3a2b-4400-9eee-9ae75181f999 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:04.594536 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ef4ac038-c919-4f79-b296-00fc3cb2da16 req-585c3ed4-3a2b-4400-9eee-9ae75181f999 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:04.605662 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-ef4ac038-c919-4f79-b296-00fc3cb2da16 req-585c3ed4-3a2b-4400-9eee-9ae75181f999 service nova] Creating event network-changed:760da6e1-e95d-4104-b4c2-bc4781aafac6 for instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d on hv-cinder-85124 Jul 28 09:19:04.611113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-ef4ac038-c919-4f79-b296-00fc3cb2da16 req-585c3ed4-3a2b-4400-9eee-9ae75181f999 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031026 Jul 28 09:19:04.611854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 390/757] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:19:09.653115 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6ecb56ff-2142-4fb8-a7d5-11ab3d14dae8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:09.655268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6ecb56ff-2142-4fb8-a7d5-11ab3d14dae8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:09.661101 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6ecb56ff-2142-4fb8-a7d5-11ab3d14dae8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.661551 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6ecb56ff-2142-4fb8-a7d5-11ab3d14dae8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.662341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6ecb56ff-2142-4fb8-a7d5-11ab3d14dae8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.662805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6ecb56ff-2142-4fb8-a7d5-11ab3d14dae8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.666472 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:09.699979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6ecb56ff-2142-4fb8-a7d5-11ab3d14dae8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051259 Jul 28 09:19:09.700875 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 368/758] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:19:09 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:19:09.714452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-298807e5-4db4-4681-845c-963b7773efa9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:09.715077 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-298807e5-4db4-4681-845c-963b7773efa9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:09.722650 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-298807e5-4db4-4681-845c-963b7773efa9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.723228 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-298807e5-4db4-4681-845c-963b7773efa9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.724273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-298807e5-4db4-4681-845c-963b7773efa9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.724707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-298807e5-4db4-4681-845c-963b7773efa9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.774633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a8735a35-17a6-49a2-ac88-6c66f9561e84 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:09.775252 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a8735a35-17a6-49a2-ac88-6c66f9561e84 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:09.782953 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a8735a35-17a6-49a2-ac88-6c66f9561e84 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.783404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a8735a35-17a6-49a2-ac88-6c66f9561e84 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.784174 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a8735a35-17a6-49a2-ac88-6c66f9561e84 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.784607 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a8735a35-17a6-49a2-ac88-6c66f9561e84 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.812625 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a8735a35-17a6-49a2-ac88-6c66f9561e84 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:19:09.823726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-298807e5-4db4-4681-845c-963b7773efa9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lazy-loading 'services' on Instance uuid c5f77207-4c9e-4c6b-8948-d42f1f28c4aa {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:19:09.889137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a8735a35-17a6-49a2-ac88-6c66f9561e84 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 204 len: 0 microversion: 2.1 time: 0.119296 Jul 28 09:19:09.893097 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 369/759] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:19:09 2022] DELETE /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:19:09.899322 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7117eaaf-5ab2-439e-84ff-76a8c1af003f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:09.899942 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7117eaaf-5ab2-439e-84ff-76a8c1af003f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:09.903562 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-298807e5-4db4-4681-845c-963b7773efa9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments/cc61b4da-39ca-4b30-9116-d9362e9d6d27" status: 202 len: 0 microversion: 2.1 time: 0.193239 Jul 28 09:19:09.904025 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 391/760] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:19:09 2022] DELETE /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments/cc61b4da-39ca-4b30-9116-d9362e9d6d27 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:19:09.906966 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7117eaaf-5ab2-439e-84ff-76a8c1af003f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.907424 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7117eaaf-5ab2-439e-84ff-76a8c1af003f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.908199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7117eaaf-5ab2-439e-84ff-76a8c1af003f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.908671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7117eaaf-5ab2-439e-84ff-76a8c1af003f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.913163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4a987fbf-7098-4397-bffc-fbd98fe3b71d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:09.915499 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4a987fbf-7098-4397-bffc-fbd98fe3b71d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:09.922539 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4a987fbf-7098-4397-bffc-fbd98fe3b71d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.922988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4a987fbf-7098-4397-bffc-fbd98fe3b71d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.923759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4a987fbf-7098-4397-bffc-fbd98fe3b71d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:09.924190 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4a987fbf-7098-4397-bffc-fbd98fe3b71d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:09.953831 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4a987fbf-7098-4397-bffc-fbd98fe3b71d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044836 Jul 28 09:19:09.954692 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 392/761] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:19:09 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:10.047470 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7117eaaf-5ab2-439e-84ff-76a8c1af003f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:10.055844 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7117eaaf-5ab2-439e-84ff-76a8c1af003f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1674 microversion: 2.1 time: 0.161396 Jul 28 09:19:10.056407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 370/762] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:09 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:19:10.967760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e46d8f13-a0ef-4020-9671-bbf70a909820 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:10.969897 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e46d8f13-a0ef-4020-9671-bbf70a909820 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:10.976222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e46d8f13-a0ef-4020-9671-bbf70a909820 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:10.976661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e46d8f13-a0ef-4020-9671-bbf70a909820 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:10.977409 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e46d8f13-a0ef-4020-9671-bbf70a909820 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:10.977862 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e46d8f13-a0ef-4020-9671-bbf70a909820 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:11.005656 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e46d8f13-a0ef-4020-9671-bbf70a909820 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042652 Jul 28 09:19:11.006233 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 393/763] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:19:10 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:11.077631 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e7bc1913-b571-4a53-b7bb-0bb6a157a182 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:11.078262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e7bc1913-b571-4a53-b7bb-0bb6a157a182 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:11.084825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e7bc1913-b571-4a53-b7bb-0bb6a157a182 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:11.085268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e7bc1913-b571-4a53-b7bb-0bb6a157a182 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:11.086214 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e7bc1913-b571-4a53-b7bb-0bb6a157a182 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:11.086650 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e7bc1913-b571-4a53-b7bb-0bb6a157a182 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:11.215763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e7bc1913-b571-4a53-b7bb-0bb6a157a182 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:11.223172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e7bc1913-b571-4a53-b7bb-0bb6a157a182 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1674 microversion: 2.1 time: 0.149815 Jul 28 09:19:11.223736 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 371/764] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:11 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:12.018812 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-853840a3-db16-4931-9b88-0c9b7d5d779f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:12.021435 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-853840a3-db16-4931-9b88-0c9b7d5d779f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:12.029005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-853840a3-db16-4931-9b88-0c9b7d5d779f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.030200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-853840a3-db16-4931-9b88-0c9b7d5d779f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.031687 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-853840a3-db16-4931-9b88-0c9b7d5d779f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.032247 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-853840a3-db16-4931-9b88-0c9b7d5d779f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.066803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-853840a3-db16-4931-9b88-0c9b7d5d779f tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052686 Jul 28 09:19:12.067383 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 394/765] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:19:12 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:19:12.145273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1d185d99-bb4b-4e00-bd0b-856d3dd756da tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:12.145773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1d185d99-bb4b-4e00-bd0b-856d3dd756da tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:12.154115 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d185d99-bb4b-4e00-bd0b-856d3dd756da tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.154569 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d185d99-bb4b-4e00-bd0b-856d3dd756da tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.155348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d185d99-bb4b-4e00-bd0b-856d3dd756da tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.155783 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d185d99-bb4b-4e00-bd0b-856d3dd756da tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.182439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1d185d99-bb4b-4e00-bd0b-856d3dd756da tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:19:12.245482 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f61ed5e7-c89f-4e37-b0da-767330fabf02 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:12.246376 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f61ed5e7-c89f-4e37-b0da-767330fabf02 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:12.254159 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f61ed5e7-c89f-4e37-b0da-767330fabf02 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.255058 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f61ed5e7-c89f-4e37-b0da-767330fabf02 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.256161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f61ed5e7-c89f-4e37-b0da-767330fabf02 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.256462 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f61ed5e7-c89f-4e37-b0da-767330fabf02 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.262440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1d185d99-bb4b-4e00-bd0b-856d3dd756da tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 204 len: 0 microversion: 2.1 time: 0.120693 Jul 28 09:19:12.263067 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 372/766] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:19:12 2022] DELETE /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:19:12.272660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-473b55ce-11b3-4fd6-9a73-f59eb40745c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:12.273363 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-473b55ce-11b3-4fd6-9a73-f59eb40745c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:12.280121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-473b55ce-11b3-4fd6-9a73-f59eb40745c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.280582 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-473b55ce-11b3-4fd6-9a73-f59eb40745c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.281357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-473b55ce-11b3-4fd6-9a73-f59eb40745c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.281796 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-473b55ce-11b3-4fd6-9a73-f59eb40745c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.349038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f61ed5e7-c89f-4e37-b0da-767330fabf02 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:12.357977 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f61ed5e7-c89f-4e37-b0da-767330fabf02 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1606 microversion: 2.1 time: 0.116718 Jul 28 09:19:12.358411 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 395/767] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:12 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:19:12.525891 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-d9e7b735-ad27-4c38-bcb9-51e0d129d29d req-e2ffecde-0e53-4640-a39c-1f48f4595de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6936b19d-2a6d-4b60-a88f-549320d81537", "name": "network-vif-deleted", "tag": "e8f10ca5-9e77-4e44-90da-226feaaaae51"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:12.527897 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-473b55ce-11b3-4fd6-9a73-f59eb40745c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:12.535961 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-473b55ce-11b3-4fd6-9a73-f59eb40745c8 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1688 microversion: 2.1 time: 0.267474 Jul 28 09:19:12.539366 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-d9e7b735-ad27-4c38-bcb9-51e0d129d29d req-e2ffecde-0e53-4640-a39c-1f48f4595de6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:12.540248 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-d9e7b735-ad27-4c38-bcb9-51e0d129d29d req-e2ffecde-0e53-4640-a39c-1f48f4595de6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:12.549637 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 373/768] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:12 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1688 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:12.559258 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-d9e7b735-ad27-4c38-bcb9-51e0d129d29d req-e2ffecde-0e53-4640-a39c-1f48f4595de6 service nova] Creating event network-vif-deleted:e8f10ca5-9e77-4e44-90da-226feaaaae51 for instance 6936b19d-2a6d-4b60-a88f-549320d81537 on hv-cinder-85124 Jul 28 09:19:12.565292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-d9e7b735-ad27-4c38-bcb9-51e0d129d29d req-e2ffecde-0e53-4640-a39c-1f48f4595de6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042317 Jul 28 09:19:12.566215 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 396/769] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:13.378259 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e3b6d9b1-ec22-4264-9499-7398dd33873b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:13.378804 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e3b6d9b1-ec22-4264-9499-7398dd33873b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:13.385293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e3b6d9b1-ec22-4264-9499-7398dd33873b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:13.385773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e3b6d9b1-ec22-4264-9499-7398dd33873b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:13.386563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e3b6d9b1-ec22-4264-9499-7398dd33873b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:13.386998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e3b6d9b1-ec22-4264-9499-7398dd33873b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:13.455448 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e3b6d9b1-ec22-4264-9499-7398dd33873b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:13.462985 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e3b6d9b1-ec22-4264-9499-7398dd33873b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1606 microversion: 2.1 time: 0.088642 Jul 28 09:19:13.463547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 374/770] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:13 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:13.557023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-19c6fcf5-fe3b-473c-ac9c-e2a9be8424b5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:13.558307 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-19c6fcf5-fe3b-473c-ac9c-e2a9be8424b5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:13.565000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-19c6fcf5-fe3b-473c-ac9c-e2a9be8424b5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:13.565442 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-19c6fcf5-fe3b-473c-ac9c-e2a9be8424b5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:13.566222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-19c6fcf5-fe3b-473c-ac9c-e2a9be8424b5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:13.566657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-19c6fcf5-fe3b-473c-ac9c-e2a9be8424b5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:13.695706 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-19c6fcf5-fe3b-473c-ac9c-e2a9be8424b5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:13.699183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:13.703873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-19c6fcf5-fe3b-473c-ac9c-e2a9be8424b5 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1688 microversion: 2.1 time: 0.151103 Jul 28 09:19:13.704443 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 397/771] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:13 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:14.484068 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9fc47913-4be2-4df3-b649-ee946fe5e984 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:14.484704 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9fc47913-4be2-4df3-b649-ee946fe5e984 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:14.492162 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9fc47913-4be2-4df3-b649-ee946fe5e984 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:14.492609 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9fc47913-4be2-4df3-b649-ee946fe5e984 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:14.493362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9fc47913-4be2-4df3-b649-ee946fe5e984 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:14.493857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9fc47913-4be2-4df3-b649-ee946fe5e984 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:14.554424 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9fc47913-4be2-4df3-b649-ee946fe5e984 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:14.562171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9fc47913-4be2-4df3-b649-ee946fe5e984 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1606 microversion: 2.1 time: 0.081884 Jul 28 09:19:14.562722 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 375/772] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:14 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1606 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:14.724646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7408b052-5143-4731-99fe-b047c334dee2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:14.725260 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7408b052-5143-4731-99fe-b047c334dee2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:14.732837 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7408b052-5143-4731-99fe-b047c334dee2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:14.733315 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7408b052-5143-4731-99fe-b047c334dee2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:14.734073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7408b052-5143-4731-99fe-b047c334dee2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:14.734513 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7408b052-5143-4731-99fe-b047c334dee2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:14.858643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7408b052-5143-4731-99fe-b047c334dee2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:14.866003 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7408b052-5143-4731-99fe-b047c334dee2 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1688 microversion: 2.1 time: 0.145377 Jul 28 09:19:14.866567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 398/773] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:14 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:15.584174 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-53fc2c58-b85d-4540-a5a9-1b9fad8f6fa8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:15.584806 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-53fc2c58-b85d-4540-a5a9-1b9fad8f6fa8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:15.591218 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-53fc2c58-b85d-4540-a5a9-1b9fad8f6fa8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:15.591664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-53fc2c58-b85d-4540-a5a9-1b9fad8f6fa8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:15.592422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-53fc2c58-b85d-4540-a5a9-1b9fad8f6fa8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:15.592854 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-53fc2c58-b85d-4540-a5a9-1b9fad8f6fa8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:15.656954 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-53fc2c58-b85d-4540-a5a9-1b9fad8f6fa8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:15.664488 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-53fc2c58-b85d-4540-a5a9-1b9fad8f6fa8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 200 len: 1606 microversion: 2.1 time: 0.084426 Jul 28 09:19:15.665304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 376/774] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:15 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 1606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:15.887238 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0b3e0e68-2d9d-474b-b198-ce76017fb15c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:15.887797 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0b3e0e68-2d9d-474b-b198-ce76017fb15c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:15.894144 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b3e0e68-2d9d-474b-b198-ce76017fb15c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:15.894592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b3e0e68-2d9d-474b-b198-ce76017fb15c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:15.895343 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b3e0e68-2d9d-474b-b198-ce76017fb15c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:15.895773 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b3e0e68-2d9d-474b-b198-ce76017fb15c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:16.023747 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b3e0e68-2d9d-474b-b198-ce76017fb15c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:16.031721 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0b3e0e68-2d9d-474b-b198-ce76017fb15c tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1688 microversion: 2.1 time: 0.148476 Jul 28 09:19:16.032281 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 399/775] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:15 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:16.687350 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:16.687951 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:16.694423 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:16.694880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:16.695649 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:16.696088 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:16.710474 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] HTTP exception thrown: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Request method failure captured: Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 HTTP/1.1 Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLBxSCg9RydU9l1gfKHb5it06nm7fnTP-LKF6Le0jY8e6vLAsNnTivthLW8dj0NgfKIqCoJQiPjZV_VzppZMmAi0rUj2IHoCBuWThYPkfFnC1J4eapCaNCWhN76WNvFXUFQClifJJqeKHHnjzdUR1qy3imNJGaOvja5no1nrsQKDA4 Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:19:16.712169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7b5e309462a425a92e550dd2c72ca4d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}] Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 87b166b84ccd4300a1b862d375c137a5 Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:19:16.713861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '6936b19d-2a6d-4b60-a88f-549320d81537'} Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:16.714718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:19:16.715920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:16.717045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Returning 404 to user: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:16.717045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-daef6a83-159c-4ab6-9e89-64de1e05d918 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 404 len: 111 microversion: 2.1 time: 0.030817 Jul 28 09:19:16.717045 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 377/776] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:16 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:19:16.722947 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2858e37e-e903-4eee-ab04-ad41ecfe003e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '.version_select at 0x7fd6c771eaf0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:16.747215 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2858e37e-e903-4eee-ab04-ad41ecfe003e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105039455" status: 202 len: 0 microversion: 2.1 time: 0.027967 Jul 28 09:19:16.747994 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 400/777] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 09:19:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105039455 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:19:17.053113 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-79f6c30f-1283-4c4a-b8e6-72bd76522e1a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:17.053731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-79f6c30f-1283-4c4a-b8e6-72bd76522e1a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:17.061343 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-79f6c30f-1283-4c4a-b8e6-72bd76522e1a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:17.061727 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-79f6c30f-1283-4c4a-b8e6-72bd76522e1a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:17.062616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-79f6c30f-1283-4c4a-b8e6-72bd76522e1a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:17.063069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-79f6c30f-1283-4c4a-b8e6-72bd76522e1a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:17.153534 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-79f6c30f-1283-4c4a-b8e6-72bd76522e1a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:17.161205 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-79f6c30f-1283-4c4a-b8e6-72bd76522e1a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1620 microversion: 2.1 time: 0.112286 Jul 28 09:19:17.161770 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 378/778] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:17 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1620 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:17.409242 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cae3b54a-e064-4806-b2a2-4730a4d9400c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'create', calling method: .version_select at 0x7fd6c767bf70>, body: {"keypair": {"name": "tempest-keypair-1568218549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxhnudh8cPkXuM8Gy9lB3DBcUZgV39r9FAL667BhO9B1Dqeh1zZzCO8GYC4Mcu5XJD+/fU6/pCyHRQU5KMgCJIQtszLG0T8jVWx6V5a+f5rVi9y1w5xjczz3mH9xYt+qw=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:17.426735 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-cae3b54a-e064-4806-b2a2-4730a4d9400c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Getting quotas for project b7b5e309462a425a92e550dd2c72ca4d. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:19:17.430975 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-cae3b54a-e064-4806-b2a2-4730a4d9400c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Getting quotas for user 87b166b84ccd4300a1b862d375c137a5 and project b7b5e309462a425a92e550dd2c72ca4d. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:19:17.456801 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cae3b54a-e064-4806-b2a2-4730a4d9400c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051361 Jul 28 09:19:17.457761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 401/779] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:19:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:17.665876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-6b4e4ee2-6dd3-41c7-bbe0-b34f548c7437 req-9f03be6b-59c9-432e-849a-b15964a5324d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f77207-4c9e-4c6b-8948-d42f1f28c4aa", "name": "network-vif-deleted", "tag": "433c3376-c310-4c2a-80fa-815d10d185aa"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:17.677516 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-6b4e4ee2-6dd3-41c7-bbe0-b34f548c7437 req-9f03be6b-59c9-432e-849a-b15964a5324d service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:17.677977 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-6b4e4ee2-6dd3-41c7-bbe0-b34f548c7437 req-9f03be6b-59c9-432e-849a-b15964a5324d service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:17.691574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-6b4e4ee2-6dd3-41c7-bbe0-b34f548c7437 req-9f03be6b-59c9-432e-849a-b15964a5324d service nova] Creating event network-vif-deleted:433c3376-c310-4c2a-80fa-815d10d185aa for instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa on hv-cinder-85124 Jul 28 09:19:17.697240 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-6b4e4ee2-6dd3-41c7-bbe0-b34f548c7437 req-9f03be6b-59c9-432e-849a-b15964a5324d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037429 Jul 28 09:19:17.697856 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 379/780] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:18.183562 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:18.184342 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:18.200724 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:18.208787 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:18.209969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:18.210524 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:18.258267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:18.259048 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:18.261821 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lazy-loading 'fault' on Instance uuid c5f77207-4c9e-4c6b-8948-d42f1f28c4aa {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:19:18.311234 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:18.319679 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-716dbc5b-d0e0-4d9e-8abe-30ced8b88506 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 200 len: 1335 microversion: 2.1 time: 0.140638 Jul 28 09:19:18.320945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 402/781] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:18 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:18.868692 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-640713965", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6941e6b9-7bfc-4053-9e7d-f682ee21c51f"}], "security_groups": [{"name": "tempest-securitygroup--1385258454"}], "key_name": "tempest-keypair-1568218549", "user_data": "}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:18.968832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] validate_networks() for [('6941e6b9-7bfc-4053-9e7d-f682ee21c51f', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:19:19.331799 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:19:19.332237 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:19:19.332734 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:19:19.333165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:19:19.333570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:19:19.340920 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:19.341533 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: c5f77207-4c9e-4c6b-8948-d42f1f28c4aa] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:19.343160 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:19.343605 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:19.344394 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:19.344824 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:19.347873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:19.348330 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:19.349091 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:19.349523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:19.361580 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Getting quotas for project b7b5e309462a425a92e550dd2c72ca4d. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:19:19.363048 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] HTTP exception thrown: Instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa could not be found. Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Request method failure captured: Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa HTTP/1.1 Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lLAPGLX22q_Q72umgmxlgc_aqO594bbQCBzsIS-QcLuSvE8L3peXSJgCX3ZJfsFRvFXmpkeBL9AYxhV3YxULcppJgQE7K3YNuKQNhmzaeAPYyj2sHvKJe3wq4C7OwoS0ZyBeINcu4yhntqqK6I0lgT33c7MoghbwUrepU-74mtzo-c Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:19:19.364723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34cb634f5c154187a943a454a706f200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34cb634f5c154187a943a454a706f200", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}] Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: aff89a63c86f4e6f906988791f3c5258 Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa could not be found. Jul 28 09:19:19.366286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'c5f77207-4c9e-4c6b-8948-d42f1f28c4aa'} Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa could not be found. Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:19.367161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa could not be found. Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa could not be found. Jul 28 09:19:19.368422 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:19.369601 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Returning 404 to user: Instance c5f77207-4c9e-4c6b-8948-d42f1f28c4aa could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:19.369694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Getting quotas for user 87b166b84ccd4300a1b862d375c137a5 and project b7b5e309462a425a92e550dd2c72ca4d. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:19:19.369785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1e1cfc26-cb8f-4473-8f10-6a2d3dc4d77d tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa" status: 404 len: 111 microversion: 2.1 time: 0.029588 Jul 28 09:19:19.370078 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 403/782] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:19 2022] GET /compute/v2.1/servers/c5f77207-4c9e-4c6b-8948-d42f1f28c4aa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:19:19.374473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0b59d62b-3d7e-47ce-93c3-a606028e0a63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '.version_select at 0x7fd6c7698a60>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:19.376409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:19:19.378789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:19:19.393086 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0b59d62b-3d7e-47ce-93c3-a606028e0a63 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021030049" status: 202 len: 0 microversion: 2.1 time: 0.022033 Jul 28 09:19:19.393795 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 404/783] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 09:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021030049 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:19:19.426542 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-54452d08-7d9a-4170-87b2-948e5ccb883c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.562819 Jul 28 09:19:19.429886 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 380/784] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:19:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:19:19.438251 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7e7f4dd9-e60c-474f-95e8-5dff1a32e2de tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:19.439131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7e7f4dd9-e60c-474f-95e8-5dff1a32e2de tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:19.495957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7e7f4dd9-e60c-474f-95e8-5dff1a32e2de tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:19.503555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7e7f4dd9-e60c-474f-95e8-5dff1a32e2de tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1237 microversion: 2.1 time: 0.069102 Jul 28 09:19:19.504105 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 405/785] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:19 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:20.525408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e03f9a8c-350c-40ca-9a06-91d90677e9aa tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:20.527150 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e03f9a8c-350c-40ca-9a06-91d90677e9aa tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:20.534674 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e03f9a8c-350c-40ca-9a06-91d90677e9aa tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:20.535414 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e03f9a8c-350c-40ca-9a06-91d90677e9aa tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:20.536406 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e03f9a8c-350c-40ca-9a06-91d90677e9aa tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:20.537110 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e03f9a8c-350c-40ca-9a06-91d90677e9aa tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:20.611413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e03f9a8c-350c-40ca-9a06-91d90677e9aa tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:20.619179 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e03f9a8c-350c-40ca-9a06-91d90677e9aa tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1307 microversion: 2.1 time: 0.098397 Jul 28 09:19:20.619755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 381/786] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:20 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:21.640001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1c97ae56-4c48-40c9-997f-8173fd338277 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:21.640717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1c97ae56-4c48-40c9-997f-8173fd338277 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:21.644167 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.648093 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1c97ae56-4c48-40c9-997f-8173fd338277 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:21.649149 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1c97ae56-4c48-40c9-997f-8173fd338277 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:21.649983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1c97ae56-4c48-40c9-997f-8173fd338277 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:21.650427 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1c97ae56-4c48-40c9-997f-8173fd338277 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:21.902383 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1c97ae56-4c48-40c9-997f-8173fd338277 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:21.910332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1c97ae56-4c48-40c9-997f-8173fd338277 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1363 microversion: 2.1 time: 0.274189 Jul 28 09:19:21.910910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 406/787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:21 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:22.066826 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-d708378b-87c8-4f57-9b3f-0d3038c7ba59 req-48deb2dd-0ae3-4817-bc9e-360f130ef2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e094080e-3ffb-4929-bccd-2c882dfe6e39", "tag": "181e3f00-cd4e-4b11-be21-d4ab1e443feb"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:22.079776 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-d708378b-87c8-4f57-9b3f-0d3038c7ba59 req-48deb2dd-0ae3-4817-bc9e-360f130ef2f4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:22.080571 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-d708378b-87c8-4f57-9b3f-0d3038c7ba59 req-48deb2dd-0ae3-4817-bc9e-360f130ef2f4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:22.093531 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-d708378b-87c8-4f57-9b3f-0d3038c7ba59 req-48deb2dd-0ae3-4817-bc9e-360f130ef2f4 service nova] Creating event network-changed:181e3f00-cd4e-4b11-be21-d4ab1e443feb for instance e094080e-3ffb-4929-bccd-2c882dfe6e39 on hv-cinder-85124 Jul 28 09:19:22.099103 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-d708378b-87c8-4f57-9b3f-0d3038c7ba59 req-48deb2dd-0ae3-4817-bc9e-360f130ef2f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043330 Jul 28 09:19:22.099798 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 382/788] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:22.316865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-61513b90-523e-46ee-9694-e926006034ac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:22.317364 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-61513b90-523e-46ee-9694-e926006034ac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:22.324160 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-61513b90-523e-46ee-9694-e926006034ac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:22.324614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-61513b90-523e-46ee-9694-e926006034ac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:22.325379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-61513b90-523e-46ee-9694-e926006034ac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:22.325822 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-61513b90-523e-46ee-9694-e926006034ac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:22.352252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-61513b90-523e-46ee-9694-e926006034ac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:19:22.433661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-61513b90-523e-46ee-9694-e926006034ac tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 204 len: 0 microversion: 2.1 time: 0.119603 Jul 28 09:19:22.434672 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 407/789] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:19:22 2022] DELETE /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:22.444274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e9361070-5aba-4af4-b1b8-7ddd9ad6da35 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:22.445295 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e9361070-5aba-4af4-b1b8-7ddd9ad6da35 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:22.451770 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e9361070-5aba-4af4-b1b8-7ddd9ad6da35 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:22.452157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e9361070-5aba-4af4-b1b8-7ddd9ad6da35 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:22.452911 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e9361070-5aba-4af4-b1b8-7ddd9ad6da35 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:22.453534 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e9361070-5aba-4af4-b1b8-7ddd9ad6da35 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:22.618253 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e9361070-5aba-4af4-b1b8-7ddd9ad6da35 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:22.625590 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e9361070-5aba-4af4-b1b8-7ddd9ad6da35 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1507 microversion: 2.1 time: 0.186182 Jul 28 09:19:22.626183 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 383/790] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:22 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:22.931904 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-00347ce5-a024-4209-bc8b-666454b0b224 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:22.932609 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-00347ce5-a024-4209-bc8b-666454b0b224 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:22.939081 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-00347ce5-a024-4209-bc8b-666454b0b224 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:22.939533 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-00347ce5-a024-4209-bc8b-666454b0b224 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:22.940297 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-00347ce5-a024-4209-bc8b-666454b0b224 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:22.940738 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-00347ce5-a024-4209-bc8b-666454b0b224 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:23.070822 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-00347ce5-a024-4209-bc8b-666454b0b224 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:23.078727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-00347ce5-a024-4209-bc8b-666454b0b224 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1363 microversion: 2.1 time: 0.151092 Jul 28 09:19:23.079301 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 408/791] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:22 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:23.646295 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e5a79fc1-6329-42e8-94b1-4eb97c15dc86 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:23.646924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e5a79fc1-6329-42e8-94b1-4eb97c15dc86 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:23.653367 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e5a79fc1-6329-42e8-94b1-4eb97c15dc86 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:23.653858 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e5a79fc1-6329-42e8-94b1-4eb97c15dc86 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:23.654622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e5a79fc1-6329-42e8-94b1-4eb97c15dc86 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:23.655059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e5a79fc1-6329-42e8-94b1-4eb97c15dc86 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:23.659024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:23.782209 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e5a79fc1-6329-42e8-94b1-4eb97c15dc86 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:23.789569 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e5a79fc1-6329-42e8-94b1-4eb97c15dc86 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1507 microversion: 2.1 time: 0.147135 Jul 28 09:19:23.790158 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 384/792] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:23 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:24.099677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4ded0cda-0f4d-4f1e-8391-6da50a3f9d80 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:24.100287 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4ded0cda-0f4d-4f1e-8391-6da50a3f9d80 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:24.107455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ded0cda-0f4d-4f1e-8391-6da50a3f9d80 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:24.107895 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ded0cda-0f4d-4f1e-8391-6da50a3f9d80 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:24.108646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ded0cda-0f4d-4f1e-8391-6da50a3f9d80 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:24.109078 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ded0cda-0f4d-4f1e-8391-6da50a3f9d80 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:24.236047 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4ded0cda-0f4d-4f1e-8391-6da50a3f9d80 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:24.243389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4ded0cda-0f4d-4f1e-8391-6da50a3f9d80 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1363 microversion: 2.1 time: 0.147508 Jul 28 09:19:24.243986 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 409/793] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:24 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:24.811110 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2451b7fa-594f-4361-8c4e-8e93fc44a573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:24.811726 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2451b7fa-594f-4361-8c4e-8e93fc44a573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:24.819527 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2451b7fa-594f-4361-8c4e-8e93fc44a573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:24.820344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2451b7fa-594f-4361-8c4e-8e93fc44a573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:24.821716 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2451b7fa-594f-4361-8c4e-8e93fc44a573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:24.822227 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2451b7fa-594f-4361-8c4e-8e93fc44a573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:24.951361 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2451b7fa-594f-4361-8c4e-8e93fc44a573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:24.959105 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2451b7fa-594f-4361-8c4e-8e93fc44a573 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1507 microversion: 2.1 time: 0.152346 Jul 28 09:19:24.959664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 385/794] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:24 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:25.264314 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-950f5927-67c2-4a27-9432-1504a2906e38 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:25.264912 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-950f5927-67c2-4a27-9432-1504a2906e38 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:25.271306 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-950f5927-67c2-4a27-9432-1504a2906e38 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:25.271748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-950f5927-67c2-4a27-9432-1504a2906e38 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:25.272514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-950f5927-67c2-4a27-9432-1504a2906e38 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:25.272949 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-950f5927-67c2-4a27-9432-1504a2906e38 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:25.511738 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-950f5927-67c2-4a27-9432-1504a2906e38 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:25.518956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-950f5927-67c2-4a27-9432-1504a2906e38 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1363 microversion: 2.1 time: 0.259014 Jul 28 09:19:25.519521 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 410/795] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:25 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:25.980860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4d7d3382-c8f1-48ea-97e0-6fc630944e8a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:25.982405 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4d7d3382-c8f1-48ea-97e0-6fc630944e8a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:25.991099 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4d7d3382-c8f1-48ea-97e0-6fc630944e8a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:25.991636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4d7d3382-c8f1-48ea-97e0-6fc630944e8a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:25.992437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4d7d3382-c8f1-48ea-97e0-6fc630944e8a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:25.992914 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4d7d3382-c8f1-48ea-97e0-6fc630944e8a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:26.520592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-fcd85320-d661-44fd-a14f-481a48e56441 req-16ec417d-c01a-421a-ad85-dd6af54bd747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8684b5-28bd-4cba-a505-ac85060610e3", "name": "network-vif-deleted", "tag": "05fba3af-c7cc-4269-9374-da786cec1fa9"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:26.521131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4d7d3382-c8f1-48ea-97e0-6fc630944e8a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:26.528863 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4d7d3382-c8f1-48ea-97e0-6fc630944e8a tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 200 len: 1507 microversion: 2.1 time: 0.552683 Jul 28 09:19:26.529442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 386/796] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:25 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 1507 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:26.535645 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-fcd85320-d661-44fd-a14f-481a48e56441 req-16ec417d-c01a-421a-ad85-dd6af54bd747 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:26.536943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-fcd85320-d661-44fd-a14f-481a48e56441 req-16ec417d-c01a-421a-ad85-dd6af54bd747 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:26.546400 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bbebda5d-1da1-423c-ad1a-5f4cbca9104f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:26.547008 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bbebda5d-1da1-423c-ad1a-5f4cbca9104f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:26.551292 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-fcd85320-d661-44fd-a14f-481a48e56441 req-16ec417d-c01a-421a-ad85-dd6af54bd747 service nova] Creating event network-vif-deleted:05fba3af-c7cc-4269-9374-da786cec1fa9 for instance fb8684b5-28bd-4cba-a505-ac85060610e3 on hv-cinder-85124 Jul 28 09:19:26.555999 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bbebda5d-1da1-423c-ad1a-5f4cbca9104f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:26.556527 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bbebda5d-1da1-423c-ad1a-5f4cbca9104f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:26.557346 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bbebda5d-1da1-423c-ad1a-5f4cbca9104f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:26.557889 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bbebda5d-1da1-423c-ad1a-5f4cbca9104f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:26.558237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-fcd85320-d661-44fd-a14f-481a48e56441 req-16ec417d-c01a-421a-ad85-dd6af54bd747 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042008 Jul 28 09:19:26.559213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 411/797] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:19:26.768313 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bbebda5d-1da1-423c-ad1a-5f4cbca9104f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:26.776887 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bbebda5d-1da1-423c-ad1a-5f4cbca9104f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1363 microversion: 2.1 time: 0.240335 Jul 28 09:19:26.790635 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 387/798] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:26 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:27.551452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:27.552151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: fb8684b5-28bd-4cba-a505-ac85060610e3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:27.559450 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:27.559901 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:27.560666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:27.561107 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:27.574534 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] HTTP exception thrown: Instance fb8684b5-28bd-4cba-a505-ac85060610e3 could not be found. Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Request method failure captured: Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 HTTP/1.1 Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lLAPGLX22q_Q72umgmxlgc_aqO594bbQCBzsIS-QcLuSvE8L3peXSJgCX3ZJfsFRvFXmpkeBL9AYxhV3YxULcppJgQE7K3YNuKQNhmzaeAPYyj2sHvKJe3wq4C7OwoS0ZyBeINcu4yhntqqK6I0lgT33c7MoghbwUrepU-74mtzo-c Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:19:27.576155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34cb634f5c154187a943a454a706f200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34cb634f5c154187a943a454a706f200", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}] Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: aff89a63c86f4e6f906988791f3c5258 Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance fb8684b5-28bd-4cba-a505-ac85060610e3 could not be found. Jul 28 09:19:27.577663 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'fb8684b5-28bd-4cba-a505-ac85060610e3'} Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8684b5-28bd-4cba-a505-ac85060610e3 could not be found. Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:27.578543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8684b5-28bd-4cba-a505-ac85060610e3 could not be found. Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8684b5-28bd-4cba-a505-ac85060610e3 could not be found. Jul 28 09:19:27.579911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:27.581570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Returning 404 to user: Instance fb8684b5-28bd-4cba-a505-ac85060610e3 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:27.581570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8740e48a-8f15-483c-b89b-2b9bbcefa1fd tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3" status: 404 len: 111 microversion: 2.1 time: 0.030243 Jul 28 09:19:27.581570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 412/799] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:27 2022] GET /compute/v2.1/servers/fb8684b5-28bd-4cba-a505-ac85060610e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:19:27.586410 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-77de5463-c9d5-4a79-8055-be9c73011629 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:27.586907 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-77de5463-c9d5-4a79-8055-be9c73011629 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:27.593440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-77de5463-c9d5-4a79-8055-be9c73011629 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:27.593934 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-77de5463-c9d5-4a79-8055-be9c73011629 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:27.594700 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-77de5463-c9d5-4a79-8055-be9c73011629 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:27.595148 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-77de5463-c9d5-4a79-8055-be9c73011629 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:27.621514 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-77de5463-c9d5-4a79-8055-be9c73011629 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:19:27.694001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-77de5463-c9d5-4a79-8055-be9c73011629 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 204 len: 0 microversion: 2.1 time: 0.111128 Jul 28 09:19:27.694500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 388/800] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:19:27 2022] DELETE /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:27.703574 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-140de445-efed-40a3-a35c-f50012cdb216 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:27.704186 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-140de445-efed-40a3-a35c-f50012cdb216 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:27.710572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-140de445-efed-40a3-a35c-f50012cdb216 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:27.711083 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-140de445-efed-40a3-a35c-f50012cdb216 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:27.711871 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-140de445-efed-40a3-a35c-f50012cdb216 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:27.712307 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-140de445-efed-40a3-a35c-f50012cdb216 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:27.799550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5140ae5a-2a09-45a6-84b2-18119ea30a1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:27.800322 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5140ae5a-2a09-45a6-84b2-18119ea30a1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:27.806493 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5140ae5a-2a09-45a6-84b2-18119ea30a1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:27.807012 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5140ae5a-2a09-45a6-84b2-18119ea30a1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:27.808427 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5140ae5a-2a09-45a6-84b2-18119ea30a1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:27.808861 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5140ae5a-2a09-45a6-84b2-18119ea30a1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:27.844338 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-140de445-efed-40a3-a35c-f50012cdb216 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:27.851894 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-140de445-efed-40a3-a35c-f50012cdb216 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.153110 Jul 28 09:19:27.852474 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 413/801] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:27 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:27.937548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5140ae5a-2a09-45a6-84b2-18119ea30a1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:27.945164 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5140ae5a-2a09-45a6-84b2-18119ea30a1b tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1363 microversion: 2.1 time: 0.149729 Jul 28 09:19:27.945664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 389/802] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:27 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:19:28.872455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-f90c4781-d838-4ea3-8cfa-fe14ec6b93b5 req-7413b944-a8a6-4f96-a387-913a9953d024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e094080e-3ffb-4929-bccd-2c882dfe6e39", "name": "network-vif-plugged", "status": "completed", "tag": "181e3f00-cd4e-4b11-be21-d4ab1e443feb"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:28.873219 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7c43c33d-8392-4a23-a2e9-bf781c41fda3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:28.873829 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7c43c33d-8392-4a23-a2e9-bf781c41fda3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:28.879929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:28.881781 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c43c33d-8392-4a23-a2e9-bf781c41fda3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:28.882297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c43c33d-8392-4a23-a2e9-bf781c41fda3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:28.883385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c43c33d-8392-4a23-a2e9-bf781c41fda3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:28.883937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7c43c33d-8392-4a23-a2e9-bf781c41fda3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:28.884707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f90c4781-d838-4ea3-8cfa-fe14ec6b93b5 req-7413b944-a8a6-4f96-a387-913a9953d024 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:28.885304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f90c4781-d838-4ea3-8cfa-fe14ec6b93b5 req-7413b944-a8a6-4f96-a387-913a9953d024 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:28.897728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-f90c4781-d838-4ea3-8cfa-fe14ec6b93b5 req-7413b944-a8a6-4f96-a387-913a9953d024 service nova] Creating event network-vif-plugged:181e3f00-cd4e-4b11-be21-d4ab1e443feb for instance e094080e-3ffb-4929-bccd-2c882dfe6e39 on hv-cinder-85124 Jul 28 09:19:28.903668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-f90c4781-d838-4ea3-8cfa-fe14ec6b93b5 req-7413b944-a8a6-4f96-a387-913a9953d024 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035312 Jul 28 09:19:28.904608 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 414/803] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:28.967129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-74361739-3f0b-4000-8757-59d38af18dd6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:28.967824 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-74361739-3f0b-4000-8757-59d38af18dd6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:28.983027 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74361739-3f0b-4000-8757-59d38af18dd6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:28.983758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74361739-3f0b-4000-8757-59d38af18dd6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:28.985118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74361739-3f0b-4000-8757-59d38af18dd6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:28.985743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74361739-3f0b-4000-8757-59d38af18dd6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:29.201269 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-7c43c33d-8392-4a23-a2e9-bf781c41fda3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:29.209064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7c43c33d-8392-4a23-a2e9-bf781c41fda3 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1520 microversion: 2.1 time: 0.340467 Jul 28 09:19:29.209708 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 390/804] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:28 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:29.242814 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-9d786946-5e4d-48f5-abaa-8a3c0537e687 req-d9f236e1-397e-4794-a16b-33a6153d96f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e208af-ae8f-482f-b140-66e820fb9f4c", "name": "network-vif-deleted", "tag": "89af98d3-0e6d-4025-b5bf-6a18fba6c7de"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:29.253722 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-9d786946-5e4d-48f5-abaa-8a3c0537e687 req-d9f236e1-397e-4794-a16b-33a6153d96f6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:29.254207 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-9d786946-5e4d-48f5-abaa-8a3c0537e687 req-d9f236e1-397e-4794-a16b-33a6153d96f6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:29.266220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-9d786946-5e4d-48f5-abaa-8a3c0537e687 req-d9f236e1-397e-4794-a16b-33a6153d96f6 service nova] Creating event network-vif-deleted:89af98d3-0e6d-4025-b5bf-6a18fba6c7de for instance 25e208af-ae8f-482f-b140-66e820fb9f4c on hv-cinder-85124 Jul 28 09:19:29.271631 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-9d786946-5e4d-48f5-abaa-8a3c0537e687 req-d9f236e1-397e-4794-a16b-33a6153d96f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032518 Jul 28 09:19:29.272993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 391/805] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:19:29.288685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-74361739-3f0b-4000-8757-59d38af18dd6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:29.296677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-74361739-3f0b-4000-8757-59d38af18dd6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1363 microversion: 2.1 time: 0.333763 Jul 28 09:19:29.297250 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 415/806] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:28 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:19:30.227723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.228574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=6 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.233962 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:30.234702 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:30.242461 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:30.242919 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:30.243833 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:30.244301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:30.277525 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:30.278001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:30.278440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lazy-loading 'fault' on Instance uuid 25e208af-ae8f-482f-b140-66e820fb9f4c {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:19:30.318509 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1d2d3f77-2a09-45ee-9851-fd44eaa357ea tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:30.319119 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1d2d3f77-2a09-45ee-9851-fd44eaa357ea tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:30.322162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.322720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff89a63c86f4e6f906988791f3c5258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34cb634f5c154187a943a454a706f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:30.327294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d2d3f77-2a09-45ee-9851-fd44eaa357ea tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:30.327744 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d2d3f77-2a09-45ee-9851-fd44eaa357ea tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:30.328709 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d2d3f77-2a09-45ee-9851-fd44eaa357ea tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:30.329151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d2d3f77-2a09-45ee-9851-fd44eaa357ea tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:30.330490 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5f10fbe6-e029-42e7-bdfd-d5d6495a04d9 tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 200 len: 1311 microversion: 2.1 time: 0.103436 Jul 28 09:19:30.331054 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 392/807] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:30 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:30.458740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1d2d3f77-2a09-45ee-9851-fd44eaa357ea tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:30.466584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1d2d3f77-2a09-45ee-9851-fd44eaa357ea tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1363 microversion: 2.1 time: 0.152122 Jul 28 09:19:30.467148 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 416/808] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:30 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:19:31.351643 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:31.352421 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] [instance: 25e208af-ae8f-482f-b140-66e820fb9f4c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:31.360011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:31.360587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:31.361421 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:31.361878 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:31.375728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] HTTP exception thrown: Instance 25e208af-ae8f-482f-b140-66e820fb9f4c could not be found. Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Request method failure captured: Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c HTTP/1.1 Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLAPGLX22q_Q72umgmxlgc_aqO594bbQCBzsIS-QcLuSvE8L3peXSJgCX3ZJfsFRvFXmpkeBL9AYxhV3YxULcppJgQE7K3YNuKQNhmzaeAPYyj2sHvKJe3wq4C7OwoS0ZyBeINcu4yhntqqK6I0lgT33c7MoghbwUrepU-74mtzo-c Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:19:31.377347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34cb634f5c154187a943a454a706f200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34cb634f5c154187a943a454a706f200", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34cb634f5c154187a943a454a706f200"}]}] Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 34cb634f5c154187a943a454a706f200 Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1057663818 Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: aff89a63c86f4e6f906988791f3c5258 Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1057663818-project Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 25e208af-ae8f-482f-b140-66e820fb9f4c could not be found. Jul 28 09:19:31.378928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '25e208af-ae8f-482f-b140-66e820fb9f4c'} Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e208af-ae8f-482f-b140-66e820fb9f4c could not be found. Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:31.379788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e208af-ae8f-482f-b140-66e820fb9f4c could not be found. Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e208af-ae8f-482f-b140-66e820fb9f4c could not be found. Jul 28 09:19:31.381043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:31.382125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] Returning 404 to user: Instance 25e208af-ae8f-482f-b140-66e820fb9f4c could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:31.382125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ad1a22bd-613a-4fb9-9fa6-b07eee9e6e5e tempest-ServerRescueNegativeTestJSON-1057663818 tempest-ServerRescueNegativeTestJSON-1057663818-project] 10.222.0.48 "GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c" status: 404 len: 111 microversion: 2.1 time: 0.030996 Jul 28 09:19:31.382125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 393/809] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:31 2022] GET /compute/v2.1/servers/25e208af-ae8f-482f-b140-66e820fb9f4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:19:31.488660 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f28050bd-91da-4ac0-8c17-44589ae738df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:31.489442 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f28050bd-91da-4ac0-8c17-44589ae738df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:31.497181 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f28050bd-91da-4ac0-8c17-44589ae738df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:31.497639 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f28050bd-91da-4ac0-8c17-44589ae738df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:31.498734 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f28050bd-91da-4ac0-8c17-44589ae738df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:31.499185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f28050bd-91da-4ac0-8c17-44589ae738df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:31.635460 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f28050bd-91da-4ac0-8c17-44589ae738df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:19:31.642979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f28050bd-91da-4ac0-8c17-44589ae738df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1548 microversion: 2.1 time: 0.158331 Jul 28 09:19:31.643603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 417/810] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:19:31 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:31.664368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d2c2b069-c81d-4e33-9bd5-ade6781f5699 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:31.664941 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d2c2b069-c81d-4e33-9bd5-ade6781f5699 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:19:31.671485 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2c2b069-c81d-4e33-9bd5-ade6781f5699 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:31.672002 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2c2b069-c81d-4e33-9bd5-ade6781f5699 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:31.672844 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2c2b069-c81d-4e33-9bd5-ade6781f5699 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:31.673275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d2c2b069-c81d-4e33-9bd5-ade6781f5699 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:31.782994 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d2c2b069-c81d-4e33-9bd5-ade6781f5699 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122365 Jul 28 09:19:31.783585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 394/811] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 09:19:31 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:32.967641 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-4ca911c1-80c4-4d0a-b7af-274bb143a8ba req-b9185e13-c090-4f59-b9e8-df60ae9ae29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e094080e-3ffb-4929-bccd-2c882dfe6e39", "tag": "181e3f00-cd4e-4b11-be21-d4ab1e443feb"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:32.978389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-4ca911c1-80c4-4d0a-b7af-274bb143a8ba req-b9185e13-c090-4f59-b9e8-df60ae9ae29c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:19:32.978996 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-4ca911c1-80c4-4d0a-b7af-274bb143a8ba req-b9185e13-c090-4f59-b9e8-df60ae9ae29c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:19:32.993497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-4ca911c1-80c4-4d0a-b7af-274bb143a8ba req-b9185e13-c090-4f59-b9e8-df60ae9ae29c service nova] Creating event network-changed:181e3f00-cd4e-4b11-be21-d4ab1e443feb for instance e094080e-3ffb-4929-bccd-2c882dfe6e39 on hv-cinder-85124 Jul 28 09:19:32.999328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-4ca911c1-80c4-4d0a-b7af-274bb143a8ba req-b9185e13-c090-4f59-b9e8-df60ae9ae29c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035278 Jul 28 09:19:32.999954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 418/812] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:36.605800 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-19fd1836-e19e-4990-aa87-13da3e0c303b tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Action: 'create', calling method: .version_select at 0x7fd6c76779d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-401647770", "metadata": {"Type": "work"}}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-19fd1836-e19e-4990-aa87-13da3e0c303b tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Request method failure captured: Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 121 Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lSooi-f2jjRF5vwCDVJXaq_XMVi4m2o6PLWz52N8PLXnlfNpWOELI5JAfGmcyRYYShxrbJQrUifBkbkBTZadT7_6SztSdjOAFH5yMvdncS_FX7ltORZAbEqktdi5gVjrTb_kQ5_FKKCkM4DaV9JSz8Jsjdn26aswY12GF-2mhhyYHI Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:19:36.619500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/481ef05fe4444c3caf20f39264088add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_481ef05fe4444c3caf20f39264088add", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}] Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: dfc92f9a448e42d986327578895d6aab Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-401647770", "metadata": {"Type": "work"}}} Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: Jul 28 09:19:36.621998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-401647770', 'metadata': {'Type': 'work'}}}} Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise error Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:36.623574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 09:19:36.625297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 09:19:36.626980 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 09:19:36.626980 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.626980 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-19fd1836-e19e-4990-aa87-13da3e0c303b tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:36.626980 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-19fd1836-e19e-4990-aa87-13da3e0c303b tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.159603 Jul 28 09:19:36.626980 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 395/813] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Jul 28 09:19:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:19:36.632094 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e4e45b28-75ac-4c79-a53b-c3791eb4bba0 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Action: 'create', calling method: .version_select at 0x7fd6c76a00d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-672543192", "metadata": {"Type": "work"}}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e4e45b28-75ac-4c79-a53b-c3791eb4bba0 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Request method failure captured: Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 119 Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lSooi-f2jjRF5vwCDVJXaq_XMVi4m2o6PLWz52N8PLXnlfNpWOELI5JAfGmcyRYYShxrbJQrUifBkbkBTZadT7_6SztSdjOAFH5yMvdncS_FX7ltORZAbEqktdi5gVjrTb_kQ5_FKKCkM4DaV9JSz8Jsjdn26aswY12GF-2mhhyYHI Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:19:36.636785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/481ef05fe4444c3caf20f39264088add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_481ef05fe4444c3caf20f39264088add", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}] Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: dfc92f9a448e42d986327578895d6aab Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-672543192", "metadata": {"Type": "work"}}} Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: Jul 28 09:19:36.638392 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-672543192', 'metadata': {'Type': 'work'}}}} Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise error Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi '0' Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:36.639350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 09:19:36.640881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 09:19:36.642216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 09:19:36.642216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.642216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e4e45b28-75ac-4c79-a53b-c3791eb4bba0 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:36.642216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e4e45b28-75ac-4c79-a53b-c3791eb4bba0 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010700 Jul 28 09:19:36.642216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 419/814] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Jul 28 09:19:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:19:36.647747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8f927b94-c58a-4a1e-bfa9-9a6e846d8e85 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Action: 'create', calling method: .version_select at 0x7fd6c76ce5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-249833712", "metadata": {"Type": "work"}}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8f927b94-c58a-4a1e-bfa9-9a6e846d8e85 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Request method failure captured: Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 118 Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lSooi-f2jjRF5vwCDVJXaq_XMVi4m2o6PLWz52N8PLXnlfNpWOELI5JAfGmcyRYYShxrbJQrUifBkbkBTZadT7_6SztSdjOAFH5yMvdncS_FX7ltORZAbEqktdi5gVjrTb_kQ5_FKKCkM4DaV9JSz8Jsjdn26aswY12GF-2mhhyYHI Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:19:36.651271 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/481ef05fe4444c3caf20f39264088add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_481ef05fe4444c3caf20f39264088add", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}] Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: dfc92f9a448e42d986327578895d6aab Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-249833712", "metadata": {"Type": "work"}}} Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: Jul 28 09:19:36.652838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-249833712', 'metadata': {'Type': 'work'}}}} Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise error Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi '' Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:36.653741 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 09:19:36.655266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 09:19:36.656550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 09:19:36.656550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.656550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8f927b94-c58a-4a1e-bfa9-9a6e846d8e85 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:36.656550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8f927b94-c58a-4a1e-bfa9-9a6e846d8e85 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008620 Jul 28 09:19:36.656550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 396/815] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Jul 28 09:19:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:19:36.661275 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5f92e177-4605-488c-9996-140128fc037a tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Calling method '.version_select at 0x7fd6bef591f0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:36.690038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-5f92e177-4605-488c-9996-140128fc037a tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] HTTP exception thrown: Volume tempest-invalid-1095784344 could not be found. Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5f92e177-4605-488c-9996-140128fc037a tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Request method failure captured: Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1095784344 HTTP/1.1 Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lSooi-f2jjRF5vwCDVJXaq_XMVi4m2o6PLWz52N8PLXnlfNpWOELI5JAfGmcyRYYShxrbJQrUifBkbkBTZadT7_6SztSdjOAFH5yMvdncS_FX7ltORZAbEqktdi5gVjrTb_kQ5_FKKCkM4DaV9JSz8Jsjdn26aswY12GF-2mhhyYHI Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:19:36.693076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/481ef05fe4444c3caf20f39264088add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_481ef05fe4444c3caf20f39264088add", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}] Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: dfc92f9a448e42d986327578895d6aab Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Volume tempest-invalid-1095784344 could not be found. Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'tempest-invalid-1095784344'} Jul 28 09:19:36.694668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1095784344 could not be found. (HTTP 404) (Request-ID: req-92f34952-5004-4fb7-9c09-195a22a721e1) Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.695598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 09:19:36.696987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1095784344 could not be found. Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:19:36.698277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1095784344 could not be found. Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1095784344 could not be found. Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5f92e177-4605-488c-9996-140128fc037a tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Returning 404 to user: Volume tempest-invalid-1095784344 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5f92e177-4605-488c-9996-140128fc037a tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1095784344" status: 404 len: 99 microversion: 2.1 time: 0.036870 Jul 28 09:19:36.699698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 420/816] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 09:19:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1095784344 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 09:19:36.705900 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a9d820b2-5f0e-4c9c-8f02-dab93efaed9f tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003720 Jul 28 09:19:36.706357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 397/817] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Jul 28 09:19:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 09:19:36.714568 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0e67948c-091d-44ee-a1f7-cc87a7b68013 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003656 Jul 28 09:19:36.715063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 421/818] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 09:19:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 09:19:36.722935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7f4d0711-32d2-4c0e-a8c0-fc561907df2c tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Calling method '.version_select at 0x7fd6c7795a60>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:36.751250 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-7f4d0711-32d2-4c0e-a8c0-fc561907df2c tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] HTTP exception thrown: Volume 2fbe2454-2baf-41ce-8ac8-3ed37df440e2 could not be found. Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7f4d0711-32d2-4c0e-a8c0-fc561907df2c tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Request method failure captured: Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: DELETE /compute/v2.1/os-volumes/2fbe2454-2baf-41ce-8ac8-3ed37df440e2 HTTP/1.1 Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lSooi-f2jjRF5vwCDVJXaq_XMVi4m2o6PLWz52N8PLXnlfNpWOELI5JAfGmcyRYYShxrbJQrUifBkbkBTZadT7_6SztSdjOAFH5yMvdncS_FX7ltORZAbEqktdi5gVjrTb_kQ5_FKKCkM4DaV9JSz8Jsjdn26aswY12GF-2mhhyYHI Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:19:36.753176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/481ef05fe4444c3caf20f39264088add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_481ef05fe4444c3caf20f39264088add", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}] Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: dfc92f9a448e42d986327578895d6aab Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Volume 2fbe2454-2baf-41ce-8ac8-3ed37df440e2 could not be found. Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '2fbe2454-2baf-41ce-8ac8-3ed37df440e2'} Jul 28 09:19:36.754723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fbe2454-2baf-41ce-8ac8-3ed37df440e2 could not be found. (HTTP 404) (Request-ID: req-7d45fe64-f4c3-430e-9673-515ecc550add) Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.755627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 09:19:36.757272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fbe2454-2baf-41ce-8ac8-3ed37df440e2 could not be found. Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 09:19:36.758624 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fbe2454-2baf-41ce-8ac8-3ed37df440e2 could not be found. Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fbe2454-2baf-41ce-8ac8-3ed37df440e2 could not be found. Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7f4d0711-32d2-4c0e-a8c0-fc561907df2c tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Returning 404 to user: Volume 2fbe2454-2baf-41ce-8ac8-3ed37df440e2 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7f4d0711-32d2-4c0e-a8c0-fc561907df2c tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/2fbe2454-2baf-41ce-8ac8-3ed37df440e2" status: 404 len: 109 microversion: 2.1 time: 0.035094 Jul 28 09:19:36.760011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 398/819] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:19:36 2022] DELETE /compute/v2.1/os-volumes/2fbe2454-2baf-41ce-8ac8-3ed37df440e2 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:19:36.764846 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e336d334-ea84-4701-b941-8d1ffd0d1d31 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Calling method '.version_select at 0x7fd6c778e790>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:36.791461 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-e336d334-ea84-4701-b941-8d1ffd0d1d31 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] HTTP exception thrown: Volume 7177b5ce-0e1e-4312-9586-24b6364ed2cd could not be found. Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e336d334-ea84-4701-b941-8d1ffd0d1d31 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Request method failure captured: Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/os-volumes/7177b5ce-0e1e-4312-9586-24b6364ed2cd HTTP/1.1 Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lSooi-f2jjRF5vwCDVJXaq_XMVi4m2o6PLWz52N8PLXnlfNpWOELI5JAfGmcyRYYShxrbJQrUifBkbkBTZadT7_6SztSdjOAFH5yMvdncS_FX7ltORZAbEqktdi5gVjrTb_kQ5_FKKCkM4DaV9JSz8Jsjdn26aswY12GF-2mhhyYHI Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:19:36.793981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/481ef05fe4444c3caf20f39264088add"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_481ef05fe4444c3caf20f39264088add", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/481ef05fe4444c3caf20f39264088add"}]}] Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 481ef05fe4444c3caf20f39264088add Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesNegativeTest-1089289595 Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: dfc92f9a448e42d986327578895d6aab Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-VolumesNegativeTest-1089289595-project Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Volume 7177b5ce-0e1e-4312-9586-24b6364ed2cd could not be found. Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': '7177b5ce-0e1e-4312-9586-24b6364ed2cd'} Jul 28 09:19:36.795544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7177b5ce-0e1e-4312-9586-24b6364ed2cd could not be found. (HTTP 404) (Request-ID: req-acd500ed-ff69-42d6-98e1-74e9fd893992) Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.796632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:19:36.798024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7177b5ce-0e1e-4312-9586-24b6364ed2cd could not be found. Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 09:19:36.799191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7177b5ce-0e1e-4312-9586-24b6364ed2cd could not be found. Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7177b5ce-0e1e-4312-9586-24b6364ed2cd could not be found. Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e336d334-ea84-4701-b941-8d1ffd0d1d31 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] Returning 404 to user: Volume 7177b5ce-0e1e-4312-9586-24b6364ed2cd could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e336d334-ea84-4701-b941-8d1ffd0d1d31 tempest-VolumesNegativeTest-1089289595 tempest-VolumesNegativeTest-1089289595-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7177b5ce-0e1e-4312-9586-24b6364ed2cd" status: 404 len: 109 microversion: 2.1 time: 0.034707 Jul 28 09:19:36.800671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 422/820] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:19:36 2022] GET /compute/v2.1/os-volumes/7177b5ce-0e1e-4312-9586-24b6364ed2cd => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:20:11.504407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=11 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.505572 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.694471 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6af1264d-b727-4d47-a8ba-0dd87c7c3ecc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Action: 'create', calling method: .version_select at 0x7fd6c7677310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1279686165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbYzM9z1XcOuuSB6KuNIzqXlAh8anCk2VyQsgRW0K/KEUscNn4i6nZ8Pwqx1oqWe3z/+hzMF6vUIWnK8QKbVc7eudX2VaqKPqqpgUQsxZlu7mMXh1V8dJs9z9H7ddyBzA=="}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:11.712399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-6af1264d-b727-4d47-a8ba-0dd87c7c3ecc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Getting quotas for project 53fd239676ec42e0a9f145e924fc249a. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:20:11.720218 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-6af1264d-b727-4d47-a8ba-0dd87c7c3ecc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Getting quotas for user bcc41a77cdfb426caa5c86ecab2298e8 and project 53fd239676ec42e0a9f145e924fc249a. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:20:11.747404 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6af1264d-b727-4d47-a8ba-0dd87c7c3ecc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.244335 Jul 28 09:20:11.748011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 399/821] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:20:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:22.220181 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:22.221521 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:22.227294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e02e7060-d18f-4f5d-9f55-84485235d142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:22.228058 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e02e7060-d18f-4f5d-9f55-84485235d142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:22.237511 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e02e7060-d18f-4f5d-9f55-84485235d142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:22.237977 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e02e7060-d18f-4f5d-9f55-84485235d142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:22.238794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e02e7060-d18f-4f5d-9f55-84485235d142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:22.239246 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e02e7060-d18f-4f5d-9f55-84485235d142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:22.268044 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e02e7060-d18f-4f5d-9f55-84485235d142 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/ips" status: 200 len: 151 microversion: 2.1 time: 0.049910 Jul 28 09:20:22.268619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 423/822] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:20:22 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:23.619670 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bc4aee9d-41f5-4b73-b853-2f8130bc89ec tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d77022-b8bc-4c53-868f-9d0897d00967"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:23.621971 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bc4aee9d-41f5-4b73-b853-2f8130bc89ec tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:23.624323 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=4 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:23.624959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:23.630726 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bc4aee9d-41f5-4b73-b853-2f8130bc89ec tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:23.631174 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bc4aee9d-41f5-4b73-b853-2f8130bc89ec tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:23.631929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bc4aee9d-41f5-4b73-b853-2f8130bc89ec tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:23.632360 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bc4aee9d-41f5-4b73-b853-2f8130bc89ec tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:23.903958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bc4aee9d-41f5-4b73-b853-2f8130bc89ec tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288007 Jul 28 09:20:23.904647 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 400/823] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:20:23 2022] POST /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:32.225679 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4be5fdd3-48c4-422a-b9f4-b0036689eed1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:32.226339 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4be5fdd3-48c4-422a-b9f4-b0036689eed1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:32.233119 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4be5fdd3-48c4-422a-b9f4-b0036689eed1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:32.233565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4be5fdd3-48c4-422a-b9f4-b0036689eed1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:32.234294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4be5fdd3-48c4-422a-b9f4-b0036689eed1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:32.234818 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4be5fdd3-48c4-422a-b9f4-b0036689eed1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:32.258755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4be5fdd3-48c4-422a-b9f4-b0036689eed1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/ips" status: 200 len: 151 microversion: 2.20 time: 0.037521 Jul 28 09:20:32.259514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 424/824] 10.222.0.48 () {60 vars in 1289 bytes} [Thu Jul 28 09:20:32 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:32.490772 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d77022-b8bc-4c53-868f-9d0897d00967"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:32.493371 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:32.499811 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:32.500266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:32.501039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:32.501475 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:32.588880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Invalid volume: volume 41d77022-b8bc-4c53-868f-9d0897d00967 is already attached to instances: 30f89173-0824-45dd-bdf5-c5af808a7dd2 Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: POST /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments HTTP/1.1 Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 74 Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:20:32.590618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {"volumeAttachment": {"volumeId": "41d77022-b8bc-4c53-868f-9d0897d00967"}} Jul 28 09:20:32.592217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Invalid volume: volume 41d77022-b8bc-4c53-868f-9d0897d00967 is already attached to instances: 30f89173-0824-45dd-bdf5-c5af808a7dd2 Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'server_id': '30f89173-0824-45dd-bdf5-c5af808a7dd2', 'body': {'volumeAttachment': {'volumeId': '41d77022-b8bc-4c53-868f-9d0897d00967'}}} Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 41d77022-b8bc-4c53-868f-9d0897d00967 is already attached to instances: 30f89173-0824-45dd-bdf5-c5af808a7dd2 Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:32.593276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 41d77022-b8bc-4c53-868f-9d0897d00967 is already attached to instances: 30f89173-0824-45dd-bdf5-c5af808a7dd2 Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:20:32.594628 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:20:32.596100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:20:32.596100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:20:32.596100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:20:32.596100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 41d77022-b8bc-4c53-868f-9d0897d00967 is already attached to instances: 30f89173-0824-45dd-bdf5-c5af808a7dd2 Jul 28 09:20:32.596100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:32.596100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 400 to user: Invalid volume: volume 41d77022-b8bc-4c53-868f-9d0897d00967 is already attached to instances: 30f89173-0824-45dd-bdf5-c5af808a7dd2 {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:20:32.596100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f8b950a3-5806-4698-8766-5cdb2ca06710 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112899 Jul 28 09:20:32.596100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 401/825] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:20:32 2022] POST /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:20:32.656965 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6310f4c1-17b6-49cc-8436-71be5227084c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:32.657474 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6310f4c1-17b6-49cc-8436-71be5227084c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:32.663328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6310f4c1-17b6-49cc-8436-71be5227084c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:32.663769 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6310f4c1-17b6-49cc-8436-71be5227084c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:32.664521 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6310f4c1-17b6-49cc-8436-71be5227084c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:32.664949 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6310f4c1-17b6-49cc-8436-71be5227084c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:32.743005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-6310f4c1-17b6-49cc-8436-71be5227084c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lazy-loading 'services' on Instance uuid 30f89173-0824-45dd-bdf5-c5af808a7dd2 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:20:32.812911 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6310f4c1-17b6-49cc-8436-71be5227084c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments/41d77022-b8bc-4c53-868f-9d0897d00967" status: 202 len: 0 microversion: 2.1 time: 0.159668 Jul 28 09:20:32.813486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 425/826] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:20:32 2022] DELETE /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments/41d77022-b8bc-4c53-868f-9d0897d00967 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:20:32.822369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-67b6a508-0057-4411-85c5-25f2d792202f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:32.824493 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-67b6a508-0057-4411-85c5-25f2d792202f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:32.830921 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-67b6a508-0057-4411-85c5-25f2d792202f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:32.832298 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-67b6a508-0057-4411-85c5-25f2d792202f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:32.833220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-67b6a508-0057-4411-85c5-25f2d792202f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:32.833583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-67b6a508-0057-4411-85c5-25f2d792202f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:33.011284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-67b6a508-0057-4411-85c5-25f2d792202f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192724 Jul 28 09:20:33.011744 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 402/827] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:20:32 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:34.024023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fba0f190-e602-42eb-894c-008c484c1729 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:34.027114 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fba0f190-e602-42eb-894c-008c484c1729 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:34.035346 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fba0f190-e602-42eb-894c-008c484c1729 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:34.035796 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fba0f190-e602-42eb-894c-008c484c1729 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:34.036566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fba0f190-e602-42eb-894c-008c484c1729 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:34.037003 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fba0f190-e602-42eb-894c-008c484c1729 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:34.066062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fba0f190-e602-42eb-894c-008c484c1729 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Jul 28 09:20:34.066607 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 426/828] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:20:34 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:35.078337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4e201461-de65-4269-b5b4-c36a1e9e2ec6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:35.080486 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4e201461-de65-4269-b5b4-c36a1e9e2ec6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:35.087746 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4e201461-de65-4269-b5b4-c36a1e9e2ec6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.088194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4e201461-de65-4269-b5b4-c36a1e9e2ec6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.088953 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4e201461-de65-4269-b5b4-c36a1e9e2ec6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.089385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4e201461-de65-4269-b5b4-c36a1e9e2ec6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.117382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4e201461-de65-4269-b5b4-c36a1e9e2ec6 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043072 Jul 28 09:20:35.117937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 403/829] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:20:35 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:20:35.148004 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fc23481d-d301-4211-8fdc-bbd7d110cf0c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:35.148602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fc23481d-d301-4211-8fdc-bbd7d110cf0c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:35.155200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc23481d-d301-4211-8fdc-bbd7d110cf0c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.155643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc23481d-d301-4211-8fdc-bbd7d110cf0c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.156396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc23481d-d301-4211-8fdc-bbd7d110cf0c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.156824 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc23481d-d301-4211-8fdc-bbd7d110cf0c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.179443 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-fc23481d-d301-4211-8fdc-bbd7d110cf0c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lazy-loading 'flavor' on Instance uuid bbf9f15d-39b9-4bd4-959f-0406b46dd02d {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:20:35.180186 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6d9a2921-b57d-4f56-adf4-2266265c9601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:35.180681 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6d9a2921-b57d-4f56-adf4-2266265c9601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:35.186645 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d9a2921-b57d-4f56-adf4-2266265c9601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.187093 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d9a2921-b57d-4f56-adf4-2266265c9601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.187842 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d9a2921-b57d-4f56-adf4-2266265c9601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.188276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6d9a2921-b57d-4f56-adf4-2266265c9601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.213544 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6d9a2921-b57d-4f56-adf4-2266265c9601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:20:35.290063 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6d9a2921-b57d-4f56-adf4-2266265c9601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 204 len: 0 microversion: 2.1 time: 0.113106 Jul 28 09:20:35.290879 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 404/830] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:20:35 2022] DELETE /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:20:35.300220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-036edf48-1458-4aea-a146-96f5316e42b3 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:35.301070 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-036edf48-1458-4aea-a146-96f5316e42b3 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:35.306826 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-036edf48-1458-4aea-a146-96f5316e42b3 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.307268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-036edf48-1458-4aea-a146-96f5316e42b3 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.308016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-036edf48-1458-4aea-a146-96f5316e42b3 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.308442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-036edf48-1458-4aea-a146-96f5316e42b3 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.359665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fc23481d-d301-4211-8fdc-bbd7d110cf0c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/action" status: 202 len: 0 microversion: 2.20 time: 0.215436 Jul 28 09:20:35.360256 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 427/831] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 09:20:35 2022] POST /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:20:35.369156 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:35.369855 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:35.376128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.376552 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.377306 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:35.378381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:35.475616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-036edf48-1458-4aea-a146-96f5316e42b3 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:35.483060 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-036edf48-1458-4aea-a146-96f5316e42b3 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1684 microversion: 2.1 time: 0.187562 Jul 28 09:20:35.483622 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 405/832] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:35 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:35.530073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:35.539729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:35.541216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:35.542403 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1422183d-6e99-489d-bc20-740db782b451 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.177232 Jul 28 09:20:35.542961 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 428/833] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:35 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:20:36.493234 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1642632474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1279686165", "security_groups": [{"name": "tempest-secgroup-smoke-187518179"}], "networks": [{"uuid": "6e5822d8-ff00-4424-b54d-09f23d169007"}], "block_device_mapping_v2": [{"uuid": "97e7b573-f635-414f-a81e-dd6a1f3643ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:36.504172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-004f9f5f-57db-4dfa-af68-c2aca41a89b1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:36.504784 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-004f9f5f-57db-4dfa-af68-c2aca41a89b1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:36.511221 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-004f9f5f-57db-4dfa-af68-c2aca41a89b1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:36.511673 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-004f9f5f-57db-4dfa-af68-c2aca41a89b1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:36.512437 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-004f9f5f-57db-4dfa-af68-c2aca41a89b1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:36.512873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-004f9f5f-57db-4dfa-af68-c2aca41a89b1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:36.650459 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] validate_networks() for [('6e5822d8-ff00-4424-b54d-09f23d169007', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:20:36.729558 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-004f9f5f-57db-4dfa-af68-c2aca41a89b1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:36.737280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-004f9f5f-57db-4dfa-af68-c2aca41a89b1 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1684 microversion: 2.1 time: 0.236558 Jul 28 09:20:36.750038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 429/834] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:36 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1684 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:36.750038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:36.750038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:36.750038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:36.750497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:36.750497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:36.750665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:36.961293 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:36.969189 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:36.970711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:36.971856 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0273c971-8cce-407c-9bac-50d902f0578a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.233073 Jul 28 09:20:36.973041 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 430/835] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:36 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:37.098130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:20:37.098547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:20:37.099014 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:20:37.099444 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:20:37.099847 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:20:37.108653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:37.109092 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:37.109967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:37.110409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:37.126688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Getting quotas for project 53fd239676ec42e0a9f145e924fc249a. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:20:37.131027 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Getting quotas for user bcc41a77cdfb426caa5c86ecab2298e8 and project 53fd239676ec42e0a9f145e924fc249a. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:20:37.185566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:20:37.187664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97e7b573-f635-414f-a81e-dd6a1f3643ef',volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:20:37.313686 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-38d38362-31f5-4624-bc4f-5fb71e79117d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824237 Jul 28 09:20:37.314337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 406/836] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:20:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 09:20:37.325737 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8e003104-d0c0-4614-9a8e-9353e8cb6101 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:37.326452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8e003104-d0c0-4614-9a8e-9353e8cb6101 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:37.392503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8e003104-d0c0-4614-9a8e-9353e8cb6101 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:37.399945 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8e003104-d0c0-4614-9a8e-9353e8cb6101 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1089 microversion: 2.1 time: 0.077928 Jul 28 09:20:37.400719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 431/837] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:37 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:37.761987 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1aed02db-32bb-49c6-aac5-235ce8c56c54 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:37.762598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1aed02db-32bb-49c6-aac5-235ce8c56c54 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:37.769188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1aed02db-32bb-49c6-aac5-235ce8c56c54 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:37.769636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1aed02db-32bb-49c6-aac5-235ce8c56c54 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:37.770420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1aed02db-32bb-49c6-aac5-235ce8c56c54 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:37.770854 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1aed02db-32bb-49c6-aac5-235ce8c56c54 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:37.977459 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1aed02db-32bb-49c6-aac5-235ce8c56c54 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:37.986824 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1aed02db-32bb-49c6-aac5-235ce8c56c54 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1684 microversion: 2.1 time: 0.229337 Jul 28 09:20:37.987517 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 407/838] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:37 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1684 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:38.003420 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:38.004141 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:38.011784 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:38.012329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:38.013200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:38.014091 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:38.209280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:38.217386 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:38.218914 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:38.220078 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3c06bb23-6c7f-454a-8798-16e909bb989a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.220604 Jul 28 09:20:38.220666 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 432/839] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:37 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:38.378046 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-613a7a61-1cfe-4c2b-a1a8-231b9213d574 req-c66fc185-51a5-4401-83fa-81ec1747cd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30f89173-0824-45dd-bdf5-c5af808a7dd2", "name": "network-vif-deleted", "tag": "642c71da-4349-4b9a-a9fe-eda73d9d6417"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:38.388594 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-613a7a61-1cfe-4c2b-a1a8-231b9213d574 req-c66fc185-51a5-4401-83fa-81ec1747cd6f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:38.400946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-613a7a61-1cfe-4c2b-a1a8-231b9213d574 req-c66fc185-51a5-4401-83fa-81ec1747cd6f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:38.420652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-eab7672c-fc6a-4afe-9e79-638260a4bb9a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:38.421546 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-eab7672c-fc6a-4afe-9e79-638260a4bb9a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:38.436682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eab7672c-fc6a-4afe-9e79-638260a4bb9a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:38.437451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eab7672c-fc6a-4afe-9e79-638260a4bb9a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:38.440047 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eab7672c-fc6a-4afe-9e79-638260a4bb9a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:38.443452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eab7672c-fc6a-4afe-9e79-638260a4bb9a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:38.451901 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-613a7a61-1cfe-4c2b-a1a8-231b9213d574 req-c66fc185-51a5-4401-83fa-81ec1747cd6f service nova] Creating event network-vif-deleted:642c71da-4349-4b9a-a9fe-eda73d9d6417 for instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 on hv-cinder-85124 Jul 28 09:20:38.465620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-613a7a61-1cfe-4c2b-a1a8-231b9213d574 req-c66fc185-51a5-4401-83fa-81ec1747cd6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091193 Jul 28 09:20:38.468276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 408/840] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:38.572148 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-eab7672c-fc6a-4afe-9e79-638260a4bb9a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:38.582626 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-eab7672c-fc6a-4afe-9e79-638260a4bb9a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1205 microversion: 2.1 time: 0.164888 Jul 28 09:20:38.583813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 433/841] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:38 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1205 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:39.012376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:39.013739 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:39.026518 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:39.027331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:39.028481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:39.030866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:39.079668 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:39.080217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:39.080745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lazy-loading 'fault' on Instance uuid 30f89173-0824-45dd-bdf5-c5af808a7dd2 {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:20:39.139408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:39.148447 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0e55e326-04f5-4a5d-8015-3ec9ffd26661 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 200 len: 1332 microversion: 2.1 time: 0.140837 Jul 28 09:20:39.161880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 409/842] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:39 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:39.246584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:39.247369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:39.257446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:39.258051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:39.258971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:39.259483 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:39.603840 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-def3b6c1-ec13-41ad-846e-7838bf67e006 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:39.604442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-def3b6c1-ec13-41ad-846e-7838bf67e006 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:39.610348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-def3b6c1-ec13-41ad-846e-7838bf67e006 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:39.610790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-def3b6c1-ec13-41ad-846e-7838bf67e006 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:39.611544 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-def3b6c1-ec13-41ad-846e-7838bf67e006 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:39.611974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-def3b6c1-ec13-41ad-846e-7838bf67e006 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:39.696294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-def3b6c1-ec13-41ad-846e-7838bf67e006 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:39.703575 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-def3b6c1-ec13-41ad-846e-7838bf67e006 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1193 microversion: 2.1 time: 0.103580 Jul 28 09:20:39.704184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 410/843] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:39 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:39.739831 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:39.747689 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:39.749240 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:39.750416 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a8f05bd5-10e9-4097-8eb4-86d410a915d3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.509816 Jul 28 09:20:39.750974 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 434/844] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:39 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:40.170203 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:40.170770 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:40.177177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:40.177619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:40.178402 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:40.178831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:40.192729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 HTTP/1.1 Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:20:40.194385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:20:40.195834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '30f89173-0824-45dd-bdf5-c5af808a7dd2'} Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:20:40.196733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:20:40.198386 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:20:40.200407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:20:40.200407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-abbbf2ae-aa81-4321-815c-afb41fe6749d tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 404 len: 111 microversion: 2.1 time: 0.029583 Jul 28 09:20:40.200407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 411/845] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:40 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:20:40.204982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ba57c57b-8d90-4cfd-9b49-4c63232c8211 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '.version_select at 0x7fd6c7677c10>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:40.223980 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ba57c57b-8d90-4cfd-9b49-4c63232c8211 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132369644" status: 202 len: 0 microversion: 2.1 time: 0.023150 Jul 28 09:20:40.224702 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 435/846] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 09:20:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132369644 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:20:40.725808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ae2d26cf-d597-4bcd-9ce8-6b56bf487d2f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:40.726503 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ae2d26cf-d597-4bcd-9ce8-6b56bf487d2f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:40.735662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ae2d26cf-d597-4bcd-9ce8-6b56bf487d2f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:40.736118 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ae2d26cf-d597-4bcd-9ce8-6b56bf487d2f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:40.736903 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ae2d26cf-d597-4bcd-9ce8-6b56bf487d2f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:40.739074 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ae2d26cf-d597-4bcd-9ce8-6b56bf487d2f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:40.746009 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-f6e932d9-744c-4ec7-bd81-c21e80470214 req-a9deb6a4-f6be-4179-bae3-716afa33531f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fc20a4-19f4-47bc-aa86-fe106b753112", "tag": "a0c11b49-c1f8-46bc-898f-8e43eaaa04d4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:40.762282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f6e932d9-744c-4ec7-bd81-c21e80470214 req-a9deb6a4-f6be-4179-bae3-716afa33531f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:40.763156 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f6e932d9-744c-4ec7-bd81-c21e80470214 req-a9deb6a4-f6be-4179-bae3-716afa33531f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:40.778279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-f6e932d9-744c-4ec7-bd81-c21e80470214 req-a9deb6a4-f6be-4179-bae3-716afa33531f service nova] Creating event network-changed:a0c11b49-c1f8-46bc-898f-8e43eaaa04d4 for instance f2fc20a4-19f4-47bc-aa86-fe106b753112 on hv-cinder-85124 Jul 28 09:20:40.785167 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-f6e932d9-744c-4ec7-bd81-c21e80470214 req-a9deb6a4-f6be-4179-bae3-716afa33531f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042907 Jul 28 09:20:40.786140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 436/847] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:20:40.792254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:40.793183 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:40.802453 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:40.803298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:40.804340 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:40.804785 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:41.161648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ae2d26cf-d597-4bcd-9ce8-6b56bf487d2f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:41.169082 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ae2d26cf-d597-4bcd-9ce8-6b56bf487d2f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.447889 Jul 28 09:20:41.169648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 412/848] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:40 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:41.180284 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:41.189506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:41.191034 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:41.192192 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3722bd56-23eb-4dab-a53d-effd0838688c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.404713 Jul 28 09:20:41.192748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 437/849] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:40 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:41.384702 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-362c6f83-04fc-4e0c-b757-0c538894fd45 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: .version_select at 0x7fd6c777e280>, body: {"keypair": {"name": "tempest-keypair-556334997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxf6I2z7r90Tur1F/BbBpCbpSaNvkB+/0YPq4E83WaK44GwzwDnoqzsHmvz5WCpSPKoim5u+0VBfsm6EpV3gwyUThjyHAHgyDBhUONsazIWQxgTDZnHvQ0FuudZOu7EAQ=="}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:41.412138 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-362c6f83-04fc-4e0c-b757-0c538894fd45 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for project c957cfe3391147daab9fc1e59b414a3e. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:20:41.416969 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-362c6f83-04fc-4e0c-b757-0c538894fd45 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for user e0c1ed47784c46baa7ddc4abdfc54bbb and project c957cfe3391147daab9fc1e59b414a3e. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:20:41.440645 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-362c6f83-04fc-4e0c-b757-0c538894fd45 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062824 Jul 28 09:20:41.441570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 413/850] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:20:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:42.190299 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-89bf58ad-8d38-4561-a7bc-630fc2090dcc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:42.191478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-89bf58ad-8d38-4561-a7bc-630fc2090dcc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:42.198243 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89bf58ad-8d38-4561-a7bc-630fc2090dcc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:42.198682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89bf58ad-8d38-4561-a7bc-630fc2090dcc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:42.199481 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89bf58ad-8d38-4561-a7bc-630fc2090dcc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:42.199917 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89bf58ad-8d38-4561-a7bc-630fc2090dcc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:42.215611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:42.216636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:42.223810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:42.224434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:42.225308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:42.225869 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:42.520575 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-89bf58ad-8d38-4561-a7bc-630fc2090dcc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:42.528020 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-89bf58ad-8d38-4561-a7bc-630fc2090dcc tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.341561 Jul 28 09:20:42.528588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 438/851] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:42 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:42.532799 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:42.541297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:42.543467 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:42.544646 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-be85e99e-b238-4b7d-bf50-48135b149469 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.333570 Jul 28 09:20:42.545193 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 414/852] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:42 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:20:43.192396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1130880551", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a25c70eb-0093-412d-853c-bc88149a664e"}], "security_groups": [{"name": "tempest-securitygroup--651264761"}], "key_name": "tempest-keypair-556334997", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:43.292789 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] validate_networks() for [('a25c70eb-0093-412d-853c-bc88149a664e', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:20:43.548502 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-92ac9d38-f8a3-4151-8ec4-ef90dcc588b5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:43.549104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-92ac9d38-f8a3-4151-8ec4-ef90dcc588b5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:43.556179 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ac9d38-f8a3-4151-8ec4-ef90dcc588b5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:43.556626 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ac9d38-f8a3-4151-8ec4-ef90dcc588b5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:43.557614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ac9d38-f8a3-4151-8ec4-ef90dcc588b5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:43.557968 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-92ac9d38-f8a3-4151-8ec4-ef90dcc588b5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:43.955523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:20:43.956061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:20:43.956858 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:20:43.957265 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:20:43.957679 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:20:43.966495 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:43.966942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:43.967726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:43.968162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:43.982806 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-92ac9d38-f8a3-4151-8ec4-ef90dcc588b5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:43.985756 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for project c957cfe3391147daab9fc1e59b414a3e. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:20:43.990455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Getting quotas for user e0c1ed47784c46baa7ddc4abdfc54bbb and project c957cfe3391147daab9fc1e59b414a3e. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:20:43.990835 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-92ac9d38-f8a3-4151-8ec4-ef90dcc588b5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.446213 Jul 28 09:20:43.991392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 415/853] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:43 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:44.002011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:44.002011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:44.002235 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:20:44.002334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:44.002434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:44.003140 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:44.003604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:44.004073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:20:44.007733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:44.053456 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b4286eea-08ea-49c0-8f50-73acb587bb39 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.865700 Jul 28 09:20:44.054326 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 439/854] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:20:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:20:44.064717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3fdcfc55-fc88-4577-afc9-18e9ee208a60 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:44.065327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3fdcfc55-fc88-4577-afc9-18e9ee208a60 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:44.134225 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3fdcfc55-fc88-4577-afc9-18e9ee208a60 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:44.142702 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3fdcfc55-fc88-4577-afc9-18e9ee208a60 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1241 microversion: 2.1 time: 0.081572 Jul 28 09:20:44.156645 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 440/855] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:44 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:44.166889 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:44.176130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:44.177746 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:44.179014 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3bfbf48e-99c1-4699-acdc-f3ff614052f1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.186710 Jul 28 09:20:44.179647 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 416/856] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:43 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:45.012760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-795a548b-19aa-4f20-bb1b-870cb38f4c5b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:45.013400 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-795a548b-19aa-4f20-bb1b-870cb38f4c5b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:45.020638 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-795a548b-19aa-4f20-bb1b-870cb38f4c5b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:45.021097 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-795a548b-19aa-4f20-bb1b-870cb38f4c5b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:45.021891 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-795a548b-19aa-4f20-bb1b-870cb38f4c5b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:45.022333 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-795a548b-19aa-4f20-bb1b-870cb38f4c5b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:45.164234 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5f8f7233-9103-421f-b860-888433a773d2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:45.165332 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5f8f7233-9103-421f-b860-888433a773d2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:45.172084 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f8f7233-9103-421f-b860-888433a773d2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:45.172694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f8f7233-9103-421f-b860-888433a773d2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:45.173559 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f8f7233-9103-421f-b860-888433a773d2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:45.174323 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5f8f7233-9103-421f-b860-888433a773d2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:45.239067 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-795a548b-19aa-4f20-bb1b-870cb38f4c5b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:45.242763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:45.247288 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-795a548b-19aa-4f20-bb1b-870cb38f4c5b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.238652 Jul 28 09:20:45.247846 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 441/857] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:45 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:45.252664 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:45.253457 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:45.259321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-5f8f7233-9103-421f-b860-888433a773d2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:45.265239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:45.265766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:45.266631 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:45.267137 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:45.267747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5f8f7233-9103-421f-b860-888433a773d2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1299 microversion: 2.1 time: 0.107315 Jul 28 09:20:45.268319 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 417/858] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:45 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:45.479099 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:45.487321 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:45.489687 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:45.490990 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e4403445-b6d6-4a66-babe-11b95e6906cf tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.242226 Jul 28 09:20:45.491556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 442/859] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:45 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:46.268886 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-95ea8993-5440-4359-8927-02b6b6521f23 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:46.270135 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-95ea8993-5440-4359-8927-02b6b6521f23 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:46.276807 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-95ea8993-5440-4359-8927-02b6b6521f23 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:46.278784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-95ea8993-5440-4359-8927-02b6b6521f23 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:46.278784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-95ea8993-5440-4359-8927-02b6b6521f23 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:46.278784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-95ea8993-5440-4359-8927-02b6b6521f23 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:46.289766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3b94d08b-b7b5-4b03-bd9d-5890971f00f8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:46.290480 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3b94d08b-b7b5-4b03-bd9d-5890971f00f8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:46.303587 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b94d08b-b7b5-4b03-bd9d-5890971f00f8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:46.304108 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b94d08b-b7b5-4b03-bd9d-5890971f00f8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:46.305177 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b94d08b-b7b5-4b03-bd9d-5890971f00f8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:46.305907 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b94d08b-b7b5-4b03-bd9d-5890971f00f8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:46.598299 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-95ea8993-5440-4359-8927-02b6b6521f23 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:46.605690 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-95ea8993-5440-4359-8927-02b6b6521f23 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.340890 Jul 28 09:20:46.606227 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 418/860] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:46 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:46.610655 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:46.611250 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:46.617076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:46.617450 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:46.618230 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:46.621315 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3b94d08b-b7b5-4b03-bd9d-5890971f00f8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:46.624979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:46.629454 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3b94d08b-b7b5-4b03-bd9d-5890971f00f8 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.343787 Jul 28 09:20:46.630406 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 443/861] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:46 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:46.816631 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-d5419d88-8c6b-4950-a6e6-7e51a5454e65 req-ee34be45-cba4-4045-8270-fd255e30f432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef10647-3c4a-4486-982f-b243da6f352c", "tag": "1eee53e9-c381-4035-8bc0-2271c557daf3"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:46.826851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-d5419d88-8c6b-4950-a6e6-7e51a5454e65 req-ee34be45-cba4-4045-8270-fd255e30f432 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:46.827298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-d5419d88-8c6b-4950-a6e6-7e51a5454e65 req-ee34be45-cba4-4045-8270-fd255e30f432 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:46.836822 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:46.847015 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:46.847607 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-d5419d88-8c6b-4950-a6e6-7e51a5454e65 req-ee34be45-cba4-4045-8270-fd255e30f432 service nova] Creating event network-changed:1eee53e9-c381-4035-8bc0-2271c557daf3 for instance cef10647-3c4a-4486-982f-b243da6f352c on hv-cinder-85124 Jul 28 09:20:46.848726 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:46.850179 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cf274e15-ce7d-4f5d-9a90-e1e3ccdbd2e4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.243017 Jul 28 09:20:46.854003 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-d5419d88-8c6b-4950-a6e6-7e51a5454e65 req-ee34be45-cba4-4045-8270-fd255e30f432 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041536 Jul 28 09:20:46.855628 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 444/862] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:20:46.868994 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 419/863] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:46 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:47.626184 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-64d90e38-933d-4191-a650-9abf73eb541f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:47.626905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-64d90e38-933d-4191-a650-9abf73eb541f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:47.633123 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64d90e38-933d-4191-a650-9abf73eb541f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:47.633566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64d90e38-933d-4191-a650-9abf73eb541f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:47.634487 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64d90e38-933d-4191-a650-9abf73eb541f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:47.634922 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64d90e38-933d-4191-a650-9abf73eb541f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:47.650079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9a62c7b5-4ddc-4032-b351-8683ed666dce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:47.650684 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9a62c7b5-4ddc-4032-b351-8683ed666dce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:47.655763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:47.658454 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9a62c7b5-4ddc-4032-b351-8683ed666dce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:47.658909 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9a62c7b5-4ddc-4032-b351-8683ed666dce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:47.660190 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9a62c7b5-4ddc-4032-b351-8683ed666dce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:47.660629 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9a62c7b5-4ddc-4032-b351-8683ed666dce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:47.833172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-64d90e38-933d-4191-a650-9abf73eb541f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:47.837096 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9a62c7b5-4ddc-4032-b351-8683ed666dce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:47.840675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-64d90e38-933d-4191-a650-9abf73eb541f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.218626 Jul 28 09:20:47.841237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 445/864] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:47 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:47.844781 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9a62c7b5-4ddc-4032-b351-8683ed666dce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.198603 Jul 28 09:20:47.845416 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 420/865] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:47 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:47.876001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:47.876637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:47.882600 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:47.883054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:47.883823 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:47.884264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:48.013185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:48.021607 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:48.023181 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:48.024336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-011a18d9-a7b7-487c-b993-311ef60fb333 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.152111 Jul 28 09:20:48.024887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 446/866] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:47 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:48.862000 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d99aff39-4d64-49ce-ba22-56283825985e tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:48.863100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d99aff39-4d64-49ce-ba22-56283825985e tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:48.866477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b27eaa98-3c48-4c5a-9c9d-b9dbe85e76a7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:48.867081 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b27eaa98-3c48-4c5a-9c9d-b9dbe85e76a7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:48.870951 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d99aff39-4d64-49ce-ba22-56283825985e tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:48.871403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d99aff39-4d64-49ce-ba22-56283825985e tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:48.872230 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d99aff39-4d64-49ce-ba22-56283825985e tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:48.872664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d99aff39-4d64-49ce-ba22-56283825985e tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:48.873411 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b27eaa98-3c48-4c5a-9c9d-b9dbe85e76a7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:48.873864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b27eaa98-3c48-4c5a-9c9d-b9dbe85e76a7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:48.874637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b27eaa98-3c48-4c5a-9c9d-b9dbe85e76a7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:48.875163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b27eaa98-3c48-4c5a-9c9d-b9dbe85e76a7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:49.067101 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d99aff39-4d64-49ce-ba22-56283825985e tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:49.070857 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b27eaa98-3c48-4c5a-9c9d-b9dbe85e76a7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:49.074925 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d99aff39-4d64-49ce-ba22-56283825985e tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.216713 Jul 28 09:20:49.078011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 421/867] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:48 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:49.080433 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:49.080860 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b27eaa98-3c48-4c5a-9c9d-b9dbe85e76a7 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.218617 Jul 28 09:20:49.081041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:49.082139 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 447/868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:48 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:49.098443 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:49.098883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:49.099670 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:49.100100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:49.235268 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:49.243815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:49.245414 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:49.246598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-64e3cb17-937a-4e12-a0d8-04becbaba790 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.169735 Jul 28 09:20:49.247154 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 422/869] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:49 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:50.095904 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e669b1f6-92d7-472b-8b2b-026794cdd1c1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:50.096432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e669b1f6-92d7-472b-8b2b-026794cdd1c1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:50.102265 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-536487e9-34de-4d05-ab1d-48bf49f2c744 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:50.102879 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-536487e9-34de-4d05-ab1d-48bf49f2c744 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:50.103653 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e669b1f6-92d7-472b-8b2b-026794cdd1c1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:50.104111 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e669b1f6-92d7-472b-8b2b-026794cdd1c1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:50.104884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e669b1f6-92d7-472b-8b2b-026794cdd1c1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:50.105322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e669b1f6-92d7-472b-8b2b-026794cdd1c1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:50.109150 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-536487e9-34de-4d05-ab1d-48bf49f2c744 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:50.109606 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-536487e9-34de-4d05-ab1d-48bf49f2c744 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:50.110405 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-536487e9-34de-4d05-ab1d-48bf49f2c744 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:50.110845 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-536487e9-34de-4d05-ab1d-48bf49f2c744 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:50.306619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e669b1f6-92d7-472b-8b2b-026794cdd1c1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:50.309997 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-536487e9-34de-4d05-ab1d-48bf49f2c744 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:50.314174 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e669b1f6-92d7-472b-8b2b-026794cdd1c1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.222101 Jul 28 09:20:50.314745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 448/870] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:50 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:50.317383 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-536487e9-34de-4d05-ab1d-48bf49f2c744 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.218887 Jul 28 09:20:50.318241 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 423/871] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:50 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:50.319509 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:50.320113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:50.325820 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:50.326295 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:50.327055 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:50.327489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:50.458277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:50.466312 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:50.467808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:50.468954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-481c8845-e4dd-4434-b07a-25677f0c000e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1743 microversion: 2.20 time: 0.153307 Jul 28 09:20:50.469506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 449/872] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:50 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:51.335111 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bccad3c9-80c4-4205-80e1-1d358e9d6b3a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:51.336650 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bccad3c9-80c4-4205-80e1-1d358e9d6b3a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:51.338331 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-07ed1ef4-8c3e-45ac-ad6c-411feeb70601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:51.338948 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-07ed1ef4-8c3e-45ac-ad6c-411feeb70601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:51.343933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bccad3c9-80c4-4205-80e1-1d358e9d6b3a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:51.344448 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bccad3c9-80c4-4205-80e1-1d358e9d6b3a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:51.345146 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bccad3c9-80c4-4205-80e1-1d358e9d6b3a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:51.345427 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07ed1ef4-8c3e-45ac-ad6c-411feeb70601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:51.345611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bccad3c9-80c4-4205-80e1-1d358e9d6b3a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:51.345933 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07ed1ef4-8c3e-45ac-ad6c-411feeb70601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:51.346721 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07ed1ef4-8c3e-45ac-ad6c-411feeb70601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:51.347671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-07ed1ef4-8c3e-45ac-ad6c-411feeb70601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:51.424048 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=10 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:51.558333 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-07ed1ef4-8c3e-45ac-ad6c-411feeb70601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:51.567117 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-07ed1ef4-8c3e-45ac-ad6c-411feeb70601 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.232681 Jul 28 09:20:51.578082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 450/873] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:51 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:51.579109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bccad3c9-80c4-4205-80e1-1d358e9d6b3a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:51.584463 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-0775c530-b4d4-47d5-96a4-016925feb737 req-a493ceea-f63d-4277-b4bd-59d6b3c90e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf9f15d-39b9-4bd4-959f-0406b46dd02d", "name": "network-vif-plugged", "status": "completed", "tag": "760da6e1-e95d-4104-b4c2-bc4781aafac6"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:51.587730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bccad3c9-80c4-4205-80e1-1d358e9d6b3a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.256868 Jul 28 09:20:51.588303 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 424/874] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:51 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:51.593802 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:51.597461 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:51.598084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-0775c530-b4d4-47d5-96a4-016925feb737 req-a493ceea-f63d-4277-b4bd-59d6b3c90e40 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:51.598721 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-0775c530-b4d4-47d5-96a4-016925feb737 req-a493ceea-f63d-4277-b4bd-59d6b3c90e40 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:51.601165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:51.601751 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:51.603048 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:51.603613 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:51.614665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-0775c530-b4d4-47d5-96a4-016925feb737 req-a493ceea-f63d-4277-b4bd-59d6b3c90e40 service nova] Creating event network-vif-plugged:760da6e1-e95d-4104-b4c2-bc4781aafac6 for instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d on hv-cinder-85124 Jul 28 09:20:51.619724 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-0775c530-b4d4-47d5-96a4-016925feb737 req-a493ceea-f63d-4277-b4bd-59d6b3c90e40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039578 Jul 28 09:20:51.620415 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 451/875] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:51.742516 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:51.750275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:51.751765 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:51.752904 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1fa7b1c9-1427-42f2-87c6-36da45e92676 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1743 microversion: 2.20 time: 0.163552 Jul 28 09:20:51.754139 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 425/876] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:51 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:52.589709 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c8dd7134-56ff-44e5-9472-5164fca2cdb2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:52.590442 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c8dd7134-56ff-44e5-9472-5164fca2cdb2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:52.592423 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:52.598295 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c8dd7134-56ff-44e5-9472-5164fca2cdb2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:52.598830 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c8dd7134-56ff-44e5-9472-5164fca2cdb2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:52.599605 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c8dd7134-56ff-44e5-9472-5164fca2cdb2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:52.600038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c8dd7134-56ff-44e5-9472-5164fca2cdb2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:52.609156 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-aa34dc64-3c0e-4c6d-bfb6-d8b874505a5f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:52.610422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-aa34dc64-3c0e-4c6d-bfb6-d8b874505a5f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:52.619911 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aa34dc64-3c0e-4c6d-bfb6-d8b874505a5f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:52.620357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aa34dc64-3c0e-4c6d-bfb6-d8b874505a5f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:52.621136 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aa34dc64-3c0e-4c6d-bfb6-d8b874505a5f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:52.621744 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aa34dc64-3c0e-4c6d-bfb6-d8b874505a5f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:52.799955 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c8dd7134-56ff-44e5-9472-5164fca2cdb2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:52.808257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c8dd7134-56ff-44e5-9472-5164fca2cdb2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.223196 Jul 28 09:20:52.808836 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 452/877] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:52 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:52.814270 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:52.815061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:52.815321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-aa34dc64-3c0e-4c6d-bfb6-d8b874505a5f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:52.821204 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:52.821648 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:52.822597 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:52.823059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-aa34dc64-3c0e-4c6d-bfb6-d8b874505a5f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.218385 Jul 28 09:20:52.823210 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:52.823612 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 426/878] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:52 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:52.952425 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:52.960717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:52.962228 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:52.963365 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f92bb2fb-5319-4228-a80d-0e7365495449 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1743 microversion: 2.20 time: 0.153626 Jul 28 09:20:52.963925 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 453/879] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:52 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:53.828319 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8d792121-7365-44d1-a9bf-5ebc5ff5a75f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:53.828927 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8d792121-7365-44d1-a9bf-5ebc5ff5a75f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:53.831225 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:53.837821 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d792121-7365-44d1-a9bf-5ebc5ff5a75f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:53.838300 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d792121-7365-44d1-a9bf-5ebc5ff5a75f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:53.839064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d792121-7365-44d1-a9bf-5ebc5ff5a75f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:53.839507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8d792121-7365-44d1-a9bf-5ebc5ff5a75f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:53.844178 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-001e36ad-2bfd-4e8b-96c8-4f39b5e659bb tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:53.844787 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-001e36ad-2bfd-4e8b-96c8-4f39b5e659bb tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:53.851312 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-001e36ad-2bfd-4e8b-96c8-4f39b5e659bb tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:53.851752 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-001e36ad-2bfd-4e8b-96c8-4f39b5e659bb tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:53.852509 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-001e36ad-2bfd-4e8b-96c8-4f39b5e659bb tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:53.852944 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-001e36ad-2bfd-4e8b-96c8-4f39b5e659bb tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:53.975906 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:54.032601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8d792121-7365-44d1-a9bf-5ebc5ff5a75f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:54.039991 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8d792121-7365-44d1-a9bf-5ebc5ff5a75f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.215548 Jul 28 09:20:54.040557 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 427/880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:53 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:54.045112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:54.045543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-001e36ad-2bfd-4e8b-96c8-4f39b5e659bb tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:54.045705 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:54.052199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:54.052568 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:54.053330 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:54.053771 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:54.054398 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-001e36ad-2bfd-4e8b-96c8-4f39b5e659bb tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.213995 Jul 28 09:20:54.054962 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 454/881] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:53 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:54.179092 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:54.187126 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:54.188621 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:54.189771 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-200823df-80bb-48d7-94cd-3a73781b36a0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1743 microversion: 2.20 time: 0.148312 Jul 28 09:20:54.190347 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 428/882] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:54 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:55.060242 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e6b557e9-7783-48b1-b936-35b185dda826 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:55.060849 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e6b557e9-7783-48b1-b936-35b185dda826 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:55.062799 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=10 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:55.068799 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e6b557e9-7783-48b1-b936-35b185dda826 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:55.069270 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e6b557e9-7783-48b1-b936-35b185dda826 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:55.070149 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e6b557e9-7783-48b1-b936-35b185dda826 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:55.070589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e6b557e9-7783-48b1-b936-35b185dda826 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:55.074654 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-39fedac6-9b99-4f92-980c-21b45ceb79ca tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:55.075412 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-39fedac6-9b99-4f92-980c-21b45ceb79ca tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:55.082004 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39fedac6-9b99-4f92-980c-21b45ceb79ca tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:55.082478 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39fedac6-9b99-4f92-980c-21b45ceb79ca tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:55.083243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39fedac6-9b99-4f92-980c-21b45ceb79ca tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:55.083676 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-39fedac6-9b99-4f92-980c-21b45ceb79ca tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:55.271531 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e6b557e9-7783-48b1-b936-35b185dda826 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:55.277194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-39fedac6-9b99-4f92-980c-21b45ceb79ca tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:55.280730 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e6b557e9-7783-48b1-b936-35b185dda826 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.224264 Jul 28 09:20:55.281527 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 455/883] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:55 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:55.286787 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-39fedac6-9b99-4f92-980c-21b45ceb79ca tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.215909 Jul 28 09:20:55.287954 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 429/884] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:55 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:55.290434 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:55.291114 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:55.297458 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:55.298023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:55.298902 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:55.299438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:55.392821 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-4422bdab-8a5a-4273-ba69-844bae202205 req-8837691f-0b81-4ae3-93da-4708987023dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef10647-3c4a-4486-982f-b243da6f352c", "name": "network-vif-plugged", "status": "completed", "tag": "1eee53e9-c381-4035-8bc0-2271c557daf3"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:55.403437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-4422bdab-8a5a-4273-ba69-844bae202205 req-8837691f-0b81-4ae3-93da-4708987023dc service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:55.404258 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-4422bdab-8a5a-4273-ba69-844bae202205 req-8837691f-0b81-4ae3-93da-4708987023dc service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:55.419204 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-4422bdab-8a5a-4273-ba69-844bae202205 req-8837691f-0b81-4ae3-93da-4708987023dc service nova] Creating event network-vif-plugged:1eee53e9-c381-4035-8bc0-2271c557daf3 for instance cef10647-3c4a-4486-982f-b243da6f352c on hv-cinder-85124 Jul 28 09:20:55.424151 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-4422bdab-8a5a-4273-ba69-844bae202205 req-8837691f-0b81-4ae3-93da-4708987023dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035151 Jul 28 09:20:55.424841 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 430/885] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:20:55.435482 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:55.443434 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:55.444930 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:55.446101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a3110cc7-d146-415d-ba21-07bc74fe298b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1743 microversion: 2.20 time: 0.163300 Jul 28 09:20:55.446732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 456/886] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:55 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:56.303771 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-348b722b-5e6f-4dbb-a805-8d6dc4ab5d19 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:56.304459 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-348b722b-5e6f-4dbb-a805-8d6dc4ab5d19 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:56.306923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f9fad6fd-0614-4bb1-b86f-3ec270ac6aac tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:56.307531 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f9fad6fd-0614-4bb1-b86f-3ec270ac6aac tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:56.310856 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-348b722b-5e6f-4dbb-a805-8d6dc4ab5d19 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:56.311292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-348b722b-5e6f-4dbb-a805-8d6dc4ab5d19 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:56.312052 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-348b722b-5e6f-4dbb-a805-8d6dc4ab5d19 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:56.312491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-348b722b-5e6f-4dbb-a805-8d6dc4ab5d19 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:56.313791 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9fad6fd-0614-4bb1-b86f-3ec270ac6aac tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:56.314299 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9fad6fd-0614-4bb1-b86f-3ec270ac6aac tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:56.315055 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9fad6fd-0614-4bb1-b86f-3ec270ac6aac tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:56.315485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9fad6fd-0614-4bb1-b86f-3ec270ac6aac tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:56.507204 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f9fad6fd-0614-4bb1-b86f-3ec270ac6aac tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:56.511128 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-348b722b-5e6f-4dbb-a805-8d6dc4ab5d19 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:56.514667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f9fad6fd-0614-4bb1-b86f-3ec270ac6aac tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.211534 Jul 28 09:20:56.515263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 457/887] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:56 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:56.518581 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-348b722b-5e6f-4dbb-a805-8d6dc4ab5d19 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.220049 Jul 28 09:20:56.519294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 431/888] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:56 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:56.519610 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:56.520199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:56.526267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:56.526713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:56.527466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:56.527896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:56.653348 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:56.664939 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:56.666471 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:56.667616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c0ef0866-7707-472f-8c4c-9385a57e2eed tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1743 microversion: 2.20 time: 0.151450 Jul 28 09:20:56.668171 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 458/889] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:56 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:57.439412 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-8d0e91bd-d7b0-4bc0-9460-50ff5e9f4044 req-241c1d80-acaa-43ad-8b5b-1159d6b29464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc20a4-19f4-47bc-aa86-fe106b753112", "name": "network-vif-plugged", "status": "completed", "tag": "a0c11b49-c1f8-46bc-898f-8e43eaaa04d4"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:20:57.449130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-8d0e91bd-d7b0-4bc0-9460-50ff5e9f4044 req-241c1d80-acaa-43ad-8b5b-1159d6b29464 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:57.449565 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-8d0e91bd-d7b0-4bc0-9460-50ff5e9f4044 req-241c1d80-acaa-43ad-8b5b-1159d6b29464 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:57.460196 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-8d0e91bd-d7b0-4bc0-9460-50ff5e9f4044 req-241c1d80-acaa-43ad-8b5b-1159d6b29464 service nova] Creating event network-vif-plugged:a0c11b49-c1f8-46bc-898f-8e43eaaa04d4 for instance f2fc20a4-19f4-47bc-aa86-fe106b753112 on hv-cinder-85124 Jul 28 09:20:57.464911 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-8d0e91bd-d7b0-4bc0-9460-50ff5e9f4044 req-241c1d80-acaa-43ad-8b5b-1159d6b29464 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029195 Jul 28 09:20:57.465467 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 432/890] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:57.535718 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-78375670-b81a-4620-9a5c-71cf4008bc24 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:57.536327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-78375670-b81a-4620-9a5c-71cf4008bc24 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:57.541375 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-204ca97b-bb5c-4b36-a54c-08f981ea787b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:57.542121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-204ca97b-bb5c-4b36-a54c-08f981ea787b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:57.542777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-78375670-b81a-4620-9a5c-71cf4008bc24 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:57.543262 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-78375670-b81a-4620-9a5c-71cf4008bc24 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:57.544033 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-78375670-b81a-4620-9a5c-71cf4008bc24 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:57.544468 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-78375670-b81a-4620-9a5c-71cf4008bc24 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:57.548186 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-204ca97b-bb5c-4b36-a54c-08f981ea787b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:57.548633 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-204ca97b-bb5c-4b36-a54c-08f981ea787b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:57.549385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-204ca97b-bb5c-4b36-a54c-08f981ea787b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:57.549815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-204ca97b-bb5c-4b36-a54c-08f981ea787b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:57.746310 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-78375670-b81a-4620-9a5c-71cf4008bc24 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:57.749555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-204ca97b-bb5c-4b36-a54c-08f981ea787b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:57.756035 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:57.760784 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-78375670-b81a-4620-9a5c-71cf4008bc24 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.229310 Jul 28 09:20:57.761822 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 459/891] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:57 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:57.763777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-204ca97b-bb5c-4b36-a54c-08f981ea787b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1366 microversion: 2.1 time: 0.226556 Jul 28 09:20:57.764478 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 433/892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:57 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:57.778210 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:57.778850 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:57.784730 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:57.785806 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:57.786652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:57.787129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:57.967144 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:57.975954 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:57.977702 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:57.979363 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-08e88fef-1392-484e-b3c2-d2ae16631755 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.205867 Jul 28 09:20:57.981895 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 460/893] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:57 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:58.787423 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cdf10a65-d440-42bf-abe3-6e7a24b22cb1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:58.788329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-afc3d6f3-4528-4829-9c95-fc1e8948036b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:58.789576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-afc3d6f3-4528-4829-9c95-fc1e8948036b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:58.790049 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cdf10a65-d440-42bf-abe3-6e7a24b22cb1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:58.802436 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc3d6f3-4528-4829-9c95-fc1e8948036b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:58.804197 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cdf10a65-d440-42bf-abe3-6e7a24b22cb1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:58.804723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cdf10a65-d440-42bf-abe3-6e7a24b22cb1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:58.805572 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cdf10a65-d440-42bf-abe3-6e7a24b22cb1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:58.806079 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc3d6f3-4528-4829-9c95-fc1e8948036b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:58.806928 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc3d6f3-4528-4829-9c95-fc1e8948036b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:58.808734 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cdf10a65-d440-42bf-abe3-6e7a24b22cb1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:58.809319 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc3d6f3-4528-4829-9c95-fc1e8948036b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:58.817443 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=100 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:59.314967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cdf10a65-d440-42bf-abe3-6e7a24b22cb1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:59.318757 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-afc3d6f3-4528-4829-9c95-fc1e8948036b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:59.323629 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cdf10a65-d440-42bf-abe3-6e7a24b22cb1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1260 microversion: 2.1 time: 0.545325 Jul 28 09:20:59.325719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-afc3d6f3-4528-4829-9c95-fc1e8948036b tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1556 microversion: 2.1 time: 0.542739 Jul 28 09:20:59.326472 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 461/894] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:58 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1556 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:59.330756 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:59.331356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:59.340789 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:59.341373 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:59.342078 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:59.342508 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:59.344966 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 434/895] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:20:58 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1260 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:59.363964 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b6bbb22b-b0c8-44d5-ade4-4d17c52e0a15 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:59.364461 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b6bbb22b-b0c8-44d5-ade4-4d17c52e0a15 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:20:59.371746 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b6bbb22b-b0c8-44d5-ade4-4d17c52e0a15 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:59.372137 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b6bbb22b-b0c8-44d5-ade4-4d17c52e0a15 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:59.373068 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b6bbb22b-b0c8-44d5-ade4-4d17c52e0a15 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:20:59.373582 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b6bbb22b-b0c8-44d5-ade4-4d17c52e0a15 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:20:59.518513 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b6bbb22b-b0c8-44d5-ade4-4d17c52e0a15 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158525 Jul 28 09:20:59.519904 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 435/896] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 09:20:59 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:20:59.649280 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:59.661563 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:59.664530 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:20:59.666659 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-60e57536-7550-4670-a0ba-31145b1e08a2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.338608 Jul 28 09:20:59.667846 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 462/897] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:20:59 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:00.350766 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-90ca8042-b019-486f-aae6-ca0bbca8a118 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:00.351544 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-90ca8042-b019-486f-aae6-ca0bbca8a118 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:00.358124 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-90ca8042-b019-486f-aae6-ca0bbca8a118 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:00.358576 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-90ca8042-b019-486f-aae6-ca0bbca8a118 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:00.359613 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-90ca8042-b019-486f-aae6-ca0bbca8a118 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:00.360302 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-90ca8042-b019-486f-aae6-ca0bbca8a118 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:00.597291 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-90ca8042-b019-486f-aae6-ca0bbca8a118 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:00.608838 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-90ca8042-b019-486f-aae6-ca0bbca8a118 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1444 microversion: 2.1 time: 0.262977 Jul 28 09:21:00.612064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 436/898] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:00 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1444 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:21:00.635200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-62fc285b-fd49-4890-b26d-34515bd81213 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:00.636480 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-62fc285b-fd49-4890-b26d-34515bd81213 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:00.643091 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-62fc285b-fd49-4890-b26d-34515bd81213 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:00.643647 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-62fc285b-fd49-4890-b26d-34515bd81213 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:00.644701 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-62fc285b-fd49-4890-b26d-34515bd81213 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:00.645215 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-62fc285b-fd49-4890-b26d-34515bd81213 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:00.690419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:00.691111 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:00.699083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:00.700749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:00.701694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:00.702337 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:00.902612 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-62fc285b-fd49-4890-b26d-34515bd81213 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:00.914309 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-62fc285b-fd49-4890-b26d-34515bd81213 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1444 microversion: 2.1 time: 0.283303 Jul 28 09:21:00.916234 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 463/899] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:00 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1444 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:21:00.941151 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-426b2629-88d7-4cfc-bffd-501471b488f2 req-79b5b29f-8591-4ff4-b99e-a6b33745ff9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef10647-3c4a-4486-982f-b243da6f352c", "tag": "1eee53e9-c381-4035-8bc0-2271c557daf3"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:00.945092 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:00.955226 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-426b2629-88d7-4cfc-bffd-501471b488f2 req-79b5b29f-8591-4ff4-b99e-a6b33745ff9f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:00.955678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-426b2629-88d7-4cfc-bffd-501471b488f2 req-79b5b29f-8591-4ff4-b99e-a6b33745ff9f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:00.961945 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:00.963514 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:00.964690 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-36af02b3-2047-49b2-94a7-e7771427c6e5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.278113 Jul 28 09:21:00.970140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-426b2629-88d7-4cfc-bffd-501471b488f2 req-79b5b29f-8591-4ff4-b99e-a6b33745ff9f service nova] Creating event network-changed:1eee53e9-c381-4035-8bc0-2271c557daf3 for instance cef10647-3c4a-4486-982f-b243da6f352c on hv-cinder-85124 Jul 28 09:21:00.976686 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-426b2629-88d7-4cfc-bffd-501471b488f2 req-79b5b29f-8591-4ff4-b99e-a6b33745ff9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058448 Jul 28 09:21:00.980695 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 464/901] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:00.983937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 437/901] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:00 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:21:01.996562 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:01.998712 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:02.016803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:02.017505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:02.018688 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:02.019354 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:02.253129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:02.266852 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:02.276010 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:02.277799 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-419931f3-4b85-4837-94a5-a7f8301ded5c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.290011 Jul 28 09:21:02.280751 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 465/902] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:01 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:02.545344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e1fa3bf0-3e7f-4a37-a138-ac7505a0cc9c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:02.546523 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e1fa3bf0-3e7f-4a37-a138-ac7505a0cc9c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:02.571469 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e1fa3bf0-3e7f-4a37-a138-ac7505a0cc9c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:02.572786 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e1fa3bf0-3e7f-4a37-a138-ac7505a0cc9c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:02.574065 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e1fa3bf0-3e7f-4a37-a138-ac7505a0cc9c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:02.574750 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e1fa3bf0-3e7f-4a37-a138-ac7505a0cc9c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:02.618655 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e1fa3bf0-3e7f-4a37-a138-ac7505a0cc9c tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/ips" status: 200 len: 144 microversion: 2.1 time: 0.079175 Jul 28 09:21:02.619913 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 438/903] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:21:02 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/ips => generated 144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:03.307500 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:03.308843 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:03.316232 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:03.317272 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:03.318525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:03.319565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:03.498016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-cd551d9a-5b26-49a9-9f50-0cc02c9df571 req-763607a3-8f66-4419-b0a8-955b63d34173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fc20a4-19f4-47bc-aa86-fe106b753112", "tag": "a0c11b49-c1f8-46bc-898f-8e43eaaa04d4"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:03.508351 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-cd551d9a-5b26-49a9-9f50-0cc02c9df571 req-763607a3-8f66-4419-b0a8-955b63d34173 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:03.508785 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-cd551d9a-5b26-49a9-9f50-0cc02c9df571 req-763607a3-8f66-4419-b0a8-955b63d34173 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:03.516442 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:03.521274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-cd551d9a-5b26-49a9-9f50-0cc02c9df571 req-763607a3-8f66-4419-b0a8-955b63d34173 service nova] Creating event network-changed:a0c11b49-c1f8-46bc-898f-8e43eaaa04d4 for instance f2fc20a4-19f4-47bc-aa86-fe106b753112 on hv-cinder-85124 Jul 28 09:21:03.526356 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-cd551d9a-5b26-49a9-9f50-0cc02c9df571 req-763607a3-8f66-4419-b0a8-955b63d34173 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032533 Jul 28 09:21:03.527550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 439/904] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:03.530667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:03.533114 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:03.534845 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c6ffbda6-3abe-485e-9196-a94928a17645 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.231570 Jul 28 09:21:03.535923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 466/905] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:03 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:04.114427 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-632d0c6f-d36b-4aab-951e-9dc2ec2b2dd3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91839903-619b-458e-99a7-acd73302e183"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:04.116864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-632d0c6f-d36b-4aab-951e-9dc2ec2b2dd3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:04.130575 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-632d0c6f-d36b-4aab-951e-9dc2ec2b2dd3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:04.131023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-632d0c6f-d36b-4aab-951e-9dc2ec2b2dd3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:04.134302 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-632d0c6f-d36b-4aab-951e-9dc2ec2b2dd3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:04.135036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-632d0c6f-d36b-4aab-951e-9dc2ec2b2dd3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:04.509797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-632d0c6f-d36b-4aab-951e-9dc2ec2b2dd3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400136 Jul 28 09:21:04.515795 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 440/906] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:21:04 2022] POST /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:04.561235 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:04.561865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:04.571007 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:04.571942 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:04.573637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:04.574716 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:04.793783 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:04.804616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:04.806213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:04.807404 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f2944299-5732-4fb3-b8c4-4b9d9d363824 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.250690 Jul 28 09:21:04.810064 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 467/907] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:04 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:05.833215 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:05.833979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:05.840468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:05.840928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:05.841705 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:05.842168 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:06.018463 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:06.027311 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:06.028823 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:06.031121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6bac991a-601e-414f-a5db-ad1d8f8fb0ba tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.202177 Jul 28 09:21:06.046880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 441/908] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:05 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:07.057682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:07.058501 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:07.067808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:07.068359 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:07.069455 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:07.070025 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:07.223136 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:07.232052 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:07.233237 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:07.234743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e41bd721-773d-427f-b6a6-d3129ba2fa42 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.182369 Jul 28 09:21:07.236023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 468/909] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:07 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:08.260834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:08.261521 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:08.268439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:08.268890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:08.269672 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:08.270140 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:08.398890 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:08.406733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:08.408238 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:08.409381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6f42cde2-2a0b-4539-acf0-9fb66f2f310a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1738 microversion: 2.20 time: 0.152916 Jul 28 09:21:08.409999 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 442/910] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:08 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:09.432651 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:09.433322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:09.439750 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:09.440199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:09.440972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:09.441410 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:09.649944 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:09.657797 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:09.659304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:09.661056 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5c015f60-3f45-4e4d-9670-74de39c63b85 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1720 microversion: 2.20 time: 0.232291 Jul 28 09:21:09.661617 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 469/911] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:09 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:10.684287 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:10.684984 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:10.691958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:10.692346 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:10.693099 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:10.693532 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:10.821518 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:10.829331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:10.830864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:10.832276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-47a10e50-0834-4737-af91-3eb9a9d26a6c tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1720 microversion: 2.20 time: 0.151818 Jul 28 09:21:10.832834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 443/912] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:10 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:11.856075 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:11.856628 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:11.863643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:11.864097 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:11.864861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:11.865303 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:11.997460 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:12.006983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:12.008741 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:12.010023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f2770491-6773-4da1-9d81-da2eeab089e8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1720 microversion: 2.20 time: 0.157860 Jul 28 09:21:12.010611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 470/913] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:11 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:12.291082 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-9482c8a5-bb03-47a7-9378-5b78c3c3f9ef req-f96f2c7b-8eff-4526-980a-fdf63680158c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf9f15d-39b9-4bd4-959f-0406b46dd02d", "name": "network-vif-unplugged", "status": "completed", "tag": "760da6e1-e95d-4104-b4c2-bc4781aafac6"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:12.302525 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-9482c8a5-bb03-47a7-9378-5b78c3c3f9ef req-f96f2c7b-8eff-4526-980a-fdf63680158c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:12.302974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-9482c8a5-bb03-47a7-9378-5b78c3c3f9ef req-f96f2c7b-8eff-4526-980a-fdf63680158c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:12.314618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-9482c8a5-bb03-47a7-9378-5b78c3c3f9ef req-f96f2c7b-8eff-4526-980a-fdf63680158c service nova] Creating event network-vif-unplugged:760da6e1-e95d-4104-b4c2-bc4781aafac6 for instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d on hv-cinder-85124 Jul 28 09:21:12.319694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-9482c8a5-bb03-47a7-9378-5b78c3c3f9ef req-f96f2c7b-8eff-4526-980a-fdf63680158c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032777 Jul 28 09:21:12.320291 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 444/914] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:21:13.031938 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:13.032559 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:13.038941 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.039383 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.040135 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.040566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.182230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:13.194192 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:13.195810 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:13.197001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0dffe4a5-a7f7-4b43-be98-6e42095acd9f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1663 microversion: 2.20 time: 0.168889 Jul 28 09:21:13.197557 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 471/915] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:13 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:13.205808 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bf9eb643-ae6b-4238-a9e0-fd487f9b3b24 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:13.208912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bf9eb643-ae6b-4238-a9e0-fd487f9b3b24 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:13.215047 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bf9eb643-ae6b-4238-a9e0-fd487f9b3b24 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.215572 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bf9eb643-ae6b-4238-a9e0-fd487f9b3b24 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.216326 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bf9eb643-ae6b-4238-a9e0-fd487f9b3b24 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.216754 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bf9eb643-ae6b-4238-a9e0-fd487f9b3b24 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.223211 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9a5a41f4-8902-4e9a-8f56-ee6c6b980dd7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b32efaf8-883b-4c1c-9e94-dea616017fa2"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:13.225727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9a5a41f4-8902-4e9a-8f56-ee6c6b980dd7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:13.234207 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a5a41f4-8902-4e9a-8f56-ee6c6b980dd7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.234662 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a5a41f4-8902-4e9a-8f56-ee6c6b980dd7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.235440 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a5a41f4-8902-4e9a-8f56-ee6c6b980dd7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.235881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a5a41f4-8902-4e9a-8f56-ee6c6b980dd7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.247694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bf9eb643-ae6b-4238-a9e0-fd487f9b3b24 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Jul 28 09:21:13.248971 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 445/916] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:21:13 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:13.260966 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cb5f9a77-32be-4d0e-afc1-e2d247eeb216 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:13.261439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cb5f9a77-32be-4d0e-afc1-e2d247eeb216 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:13.267379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cb5f9a77-32be-4d0e-afc1-e2d247eeb216 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.267825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cb5f9a77-32be-4d0e-afc1-e2d247eeb216 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.268587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cb5f9a77-32be-4d0e-afc1-e2d247eeb216 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.269023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cb5f9a77-32be-4d0e-afc1-e2d247eeb216 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.308440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cb5f9a77-32be-4d0e-afc1-e2d247eeb216 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/91839903-619b-458e-99a7-acd73302e183" status: 200 len: 194 microversion: 2.1 time: 0.051349 Jul 28 09:21:13.309425 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 446/917] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Jul 28 09:21:13 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/91839903-619b-458e-99a7-acd73302e183 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:21:13.576763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9a5a41f4-8902-4e9a-8f56-ee6c6b980dd7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.357485 Jul 28 09:21:13.583587 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 472/918] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Jul 28 09:21:13 2022] POST /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/os-volume_attachments => generated 188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:21:13.723238 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5004e4a0-b71f-4370-9dc8-c33c9b9dd295 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:13.723652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5004e4a0-b71f-4370-9dc8-c33c9b9dd295 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:13.729747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5004e4a0-b71f-4370-9dc8-c33c9b9dd295 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.730217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5004e4a0-b71f-4370-9dc8-c33c9b9dd295 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.730965 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5004e4a0-b71f-4370-9dc8-c33c9b9dd295 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:13.731393 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5004e4a0-b71f-4370-9dc8-c33c9b9dd295 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:13.989960 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5004e4a0-b71f-4370-9dc8-c33c9b9dd295 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/os-volume_attachments/b32efaf8-883b-4c1c-9e94-dea616017fa2" status: 202 len: 0 microversion: 2.20 time: 0.271006 Jul 28 09:21:13.990487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 447/919] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Jul 28 09:21:13 2022] DELETE /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/os-volume_attachments/b32efaf8-883b-4c1c-9e94-dea616017fa2 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:21:14.048649 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4fd0667c-66fb-4980-af3f-108930e9ccd0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:14.049269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4fd0667c-66fb-4980-af3f-108930e9ccd0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:14.056335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4fd0667c-66fb-4980-af3f-108930e9ccd0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:14.056786 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4fd0667c-66fb-4980-af3f-108930e9ccd0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:14.057548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4fd0667c-66fb-4980-af3f-108930e9ccd0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:14.058021 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4fd0667c-66fb-4980-af3f-108930e9ccd0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:14.087044 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4fd0667c-66fb-4980-af3f-108930e9ccd0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117864) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 09:21:14.128506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:14.153694 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4fd0667c-66fb-4980-af3f-108930e9ccd0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "POST /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/action" status: 202 len: 0 microversion: 2.20 time: 0.108722 Jul 28 09:21:14.154677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 473/920] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 09:21:14 2022] POST /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:21:14.162537 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:14.163144 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:14.169598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:14.170086 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:14.170845 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:14.171285 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:14.312189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:14.320972 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:14.322548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:14.323765 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1d0a6234-0894-4968-9d6d-06d7071230f8 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1671 microversion: 2.20 time: 0.165141 Jul 28 09:21:14.324330 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 448/921] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:14 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:14.680386 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e5900d3b-8499-4f2b-9d20-d1daade28596 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d24b6a3-efee-48ba-abd2-4705c40203eb"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:14.683117 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e5900d3b-8499-4f2b-9d20-d1daade28596 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:14.690781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e5900d3b-8499-4f2b-9d20-d1daade28596 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:14.691367 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e5900d3b-8499-4f2b-9d20-d1daade28596 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:14.692219 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e5900d3b-8499-4f2b-9d20-d1daade28596 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:14.692661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e5900d3b-8499-4f2b-9d20-d1daade28596 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:14.984646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e5900d3b-8499-4f2b-9d20-d1daade28596 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "POST /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308796 Jul 28 09:21:14.985275 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 474/922] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:21:14 2022] POST /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:15.347761 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:15.348362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:15.355943 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:15.356520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:15.357483 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:15.357883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:15.364313 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:15.823338 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:15.832616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:15.834168 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:15.835563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2a7b6708-e019-432d-b53d-659513e5a97e tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.492332 Jul 28 09:21:15.836177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 449/923] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:15 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:16.863267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:16.863983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:16.870169 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:16.870613 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:16.871377 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:16.871830 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:17.186115 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:17.196715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:17.198502 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:17.199664 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4171e485-9297-4046-9fc0-905a61f3c093 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.342111 Jul 28 09:21:17.201019 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 475/924] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:16 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:18.223265 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:18.223877 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:18.230958 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:18.231408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:18.232185 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:18.232625 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:18.371249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:18.379467 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:18.381750 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:18.383587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-050eed08-c1bd-4cad-8ba3-613b7d58e6e1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.164544 Jul 28 09:21:18.384564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 450/925] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:18 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:19.408175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:19.408811 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:19.415396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:19.415838 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:19.416620 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:19.417053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:19.618558 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:19.626946 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:19.628621 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:19.630334 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2039356f-d3ec-4e72-b581-fbba894a82c2 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.226091 Jul 28 09:21:19.630967 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 476/926] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:19 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:20.654288 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:20.654928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:20.661440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:20.661989 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:20.662763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:20.663203 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:20.856778 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:20.867564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:20.869419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:20.871020 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f018cc5a-753e-4f80-81dc-8068d84d1bbc tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.220680 Jul 28 09:21:20.871824 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 451/927] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:20 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:21.898640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:21.899265 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:21.905586 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:21.906067 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:21.906820 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:21.907252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:22.036910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:22.045373 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:22.046877 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:22.048732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2ba9665d-ca8c-49b6-a06d-b5af7eb0961b tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.153871 Jul 28 09:21:22.049540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 477/928] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:21 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:23.071629 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:23.072508 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:23.080921 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:23.081397 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:23.083387 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:23.083939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:23.245289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:23.253384 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:23.254975 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:23.256176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-770ada75-1eed-4456-be8e-a97c7b274ef1 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.188609 Jul 28 09:21:23.256735 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 452/929] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:23 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:24.279865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:24.280543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:24.283686 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:24.291367 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:24.291816 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:24.292588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:24.293026 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:24.433586 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:24.442308 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:24.443865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:24.445065 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cafa72dd-b551-4a94-acd0-c97bb51e8458 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.169227 Jul 28 09:21:24.449985 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 478/930] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:24 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:25.467992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:25.473293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:25.479640 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=52 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:25.481345 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:25.481989 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:25.482947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:25.483542 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:25.620999 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:25.631403 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:25.634031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:25.635369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-55b6f5e2-e87a-45d1-b120-fb40e7287da5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.171144 Jul 28 09:21:25.650334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 453/931] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:25 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:26.659069 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:26.660132 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:26.666718 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:26.667163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:26.667916 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:26.668352 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:26.805330 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:26.813164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:26.814693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:26.815853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bedf1811-97af-4b08-bc2b-d1356d25d961 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.160735 Jul 28 09:21:26.816419 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 479/932] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:26 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:27.838723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:27.839322 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:27.845701 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:27.846176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:27.846927 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:27.847401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:27.974655 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:27.982599 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:27.984033 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:27.985177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3cd30054-d56b-4041-823c-b32942e00b54 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.150322 Jul 28 09:21:27.985728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 454/933] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:27 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:29.130294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:29.130906 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:29.136777 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:29.137224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:29.138021 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:29.138459 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:29.268771 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:29.277038 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:29.278576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:29.279728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3ec0f889-ecde-438d-8f01-367c7dce87d4 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.273910 Jul 28 09:21:29.280284 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 480/934] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:29 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:30.303452 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:30.304055 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:30.310528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:30.310993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:30.311722 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:30.312153 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:30.440332 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:30.448073 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:30.449567 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:30.450747 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b2b3de07-4372-4d55-9dd9-616bd0f8ffc0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.151826 Jul 28 09:21:30.451286 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 455/935] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:30 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:31.473157 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:31.473764 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:31.481224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:31.481673 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:31.482466 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:31.482899 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:31.618121 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:31.625958 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:31.627476 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:31.629229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-67e0b6b4-66d3-456d-84cd-6840e1973e15 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.159396 Jul 28 09:21:31.629778 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 481/936] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:31 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:32.652255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:32.652851 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:32.659357 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:32.659801 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:32.660555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:32.660984 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:32.834112 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:32.843100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:32.844897 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:32.846331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-688009be-ef41-4095-85c0-a449f727ad12 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.197885 Jul 28 09:21:32.846894 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 456/937] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:32 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:33.293591 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0f1c7c5d-9b03-4dc8-9a87-d95933a14a4e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:33.295884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0f1c7c5d-9b03-4dc8-9a87-d95933a14a4e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:33.303138 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f1c7c5d-9b03-4dc8-9a87-d95933a14a4e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:33.303592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f1c7c5d-9b03-4dc8-9a87-d95933a14a4e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:33.304527 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f1c7c5d-9b03-4dc8-9a87-d95933a14a4e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:33.304804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f1c7c5d-9b03-4dc8-9a87-d95933a14a4e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:33.333884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0f1c7c5d-9b03-4dc8-9a87-d95933a14a4e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044131 Jul 28 09:21:33.334435 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 482/938] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:21:33 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:33.478763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ebb8206c-ed55-41f1-89b2-aca4ea6524b2 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:33.479250 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ebb8206c-ed55-41f1-89b2-aca4ea6524b2 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:33.485279 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ebb8206c-ed55-41f1-89b2-aca4ea6524b2 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:33.485710 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ebb8206c-ed55-41f1-89b2-aca4ea6524b2 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:33.486503 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ebb8206c-ed55-41f1-89b2-aca4ea6524b2 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:33.486938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ebb8206c-ed55-41f1-89b2-aca4ea6524b2 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:33.516034 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ebb8206c-ed55-41f1-89b2-aca4ea6524b2 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/91839903-619b-458e-99a7-acd73302e183" status: 200 len: 194 microversion: 2.1 time: 0.041167 Jul 28 09:21:33.516538 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 457/939] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Jul 28 09:21:33 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/91839903-619b-458e-99a7-acd73302e183 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:33.526748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-982fb6cc-f209-4062-8884-78e9b8f787fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:33.527239 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-982fb6cc-f209-4062-8884-78e9b8f787fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:33.533231 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-982fb6cc-f209-4062-8884-78e9b8f787fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:33.533679 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-982fb6cc-f209-4062-8884-78e9b8f787fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:33.534456 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-982fb6cc-f209-4062-8884-78e9b8f787fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:33.535396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-982fb6cc-f209-4062-8884-78e9b8f787fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:33.613408 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-982fb6cc-f209-4062-8884-78e9b8f787fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lazy-loading 'services' on Instance uuid e094080e-3ffb-4929-bccd-2c882dfe6e39 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:21:33.683282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-982fb6cc-f209-4062-8884-78e9b8f787fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/91839903-619b-458e-99a7-acd73302e183" status: 202 len: 0 microversion: 2.1 time: 0.160358 Jul 28 09:21:33.683862 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 483/940] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:21:33 2022] DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/91839903-619b-458e-99a7-acd73302e183 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:21:33.868557 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:33.869152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:33.875620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:33.876069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:33.876824 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:33.877254 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:34.004003 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:34.012036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:34.013527 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:34.014695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-08953b6d-0987-464e-af16-c5a43fe9e7c9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.150080 Jul 28 09:21:34.015245 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 458/941] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:33 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:35.039428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:35.040087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:35.046780 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:35.047227 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:35.047988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:35.048429 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:35.182282 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:35.190188 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:35.191693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:35.192845 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-20c159ec-f5af-4d03-99c6-af0a2344395a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.158346 Jul 28 09:21:35.193389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 484/942] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:35 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:35.855328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c0171d52-740f-4940-8929-4d17e460c3e9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:35.855853 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c0171d52-740f-4940-8929-4d17e460c3e9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:35.862189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c0171d52-740f-4940-8929-4d17e460c3e9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:35.862636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c0171d52-740f-4940-8929-4d17e460c3e9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:35.863383 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c0171d52-740f-4940-8929-4d17e460c3e9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:35.864312 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c0171d52-740f-4940-8929-4d17e460c3e9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:35.892524 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c0171d52-740f-4940-8929-4d17e460c3e9 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/3d24b6a3-efee-48ba-abd2-4705c40203eb" status: 200 len: 194 microversion: 2.1 time: 0.041108 Jul 28 09:21:35.893109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 459/943] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Jul 28 09:21:35 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/3d24b6a3-efee-48ba-abd2-4705c40203eb => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:35.903197 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e235a8a3-a2a0-4e5a-8afb-75287b87dc85 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:35.903688 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e235a8a3-a2a0-4e5a-8afb-75287b87dc85 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:35.909503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e235a8a3-a2a0-4e5a-8afb-75287b87dc85 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:35.909989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e235a8a3-a2a0-4e5a-8afb-75287b87dc85 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:35.910919 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e235a8a3-a2a0-4e5a-8afb-75287b87dc85 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:35.911356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e235a8a3-a2a0-4e5a-8afb-75287b87dc85 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:35.990249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-e235a8a3-a2a0-4e5a-8afb-75287b87dc85 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lazy-loading 'services' on Instance uuid e094080e-3ffb-4929-bccd-2c882dfe6e39 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:21:36.060978 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e235a8a3-a2a0-4e5a-8afb-75287b87dc85 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/3d24b6a3-efee-48ba-abd2-4705c40203eb" status: 202 len: 0 microversion: 2.1 time: 0.161467 Jul 28 09:21:36.061749 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 485/944] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:21:35 2022] DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments/3d24b6a3-efee-48ba-abd2-4705c40203eb => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:21:36.216539 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:36.217155 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:36.223618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:36.224071 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:36.224839 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:36.225276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:36.355374 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:36.363532 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:36.365564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:36.366743 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-78a57312-40b5-4b1a-ae50-500ef424beb7 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.154315 Jul 28 09:21:36.367301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 460/945] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:36 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:36.456882 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-554064d2-8e56-4c91-b3ac-38eed258bb54 req-d22dae05-7668-4e64-9a57-b8a17ba61944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf9f15d-39b9-4bd4-959f-0406b46dd02d", "name": "network-vif-plugged", "status": "completed", "tag": "760da6e1-e95d-4104-b4c2-bc4781aafac6"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:36.467599 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-554064d2-8e56-4c91-b3ac-38eed258bb54 req-d22dae05-7668-4e64-9a57-b8a17ba61944 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:36.468062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-554064d2-8e56-4c91-b3ac-38eed258bb54 req-d22dae05-7668-4e64-9a57-b8a17ba61944 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:36.479690 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-554064d2-8e56-4c91-b3ac-38eed258bb54 req-d22dae05-7668-4e64-9a57-b8a17ba61944 service nova] Creating event network-vif-plugged:760da6e1-e95d-4104-b4c2-bc4781aafac6 for instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d on hv-cinder-85124 Jul 28 09:21:36.484444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-554064d2-8e56-4c91-b3ac-38eed258bb54 req-d22dae05-7668-4e64-9a57-b8a17ba61944 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Jul 28 09:21:36.485185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 486/946] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:37.227709 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c573fd36-b796-4a2d-ba8b-6aae1a4677d7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:37.229947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c573fd36-b796-4a2d-ba8b-6aae1a4677d7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:37.236343 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c573fd36-b796-4a2d-ba8b-6aae1a4677d7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:37.236874 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c573fd36-b796-4a2d-ba8b-6aae1a4677d7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:37.237666 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c573fd36-b796-4a2d-ba8b-6aae1a4677d7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:37.238119 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c573fd36-b796-4a2d-ba8b-6aae1a4677d7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:37.267483 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c573fd36-b796-4a2d-ba8b-6aae1a4677d7 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043608 Jul 28 09:21:37.268038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 461/947] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:21:37 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:37.391044 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:37.391637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:37.397755 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:37.398249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:37.399131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:37.399576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:37.530778 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:37.539240 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:37.540722 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:37.541879 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3b3de692-9428-4663-a810-de343db5ece3 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.156080 Jul 28 09:21:37.542432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 487/948] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:37 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:38.280925 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7f89a943-02df-49a3-a188-cb4e8ad1780e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:38.283060 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7f89a943-02df-49a3-a188-cb4e8ad1780e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:38.292815 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7f89a943-02df-49a3-a188-cb4e8ad1780e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.293375 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7f89a943-02df-49a3-a188-cb4e8ad1780e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.294705 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7f89a943-02df-49a3-a188-cb4e8ad1780e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.295153 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7f89a943-02df-49a3-a188-cb4e8ad1780e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.325694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7f89a943-02df-49a3-a188-cb4e8ad1780e tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049325 Jul 28 09:21:38.326281 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 462/949] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:21:38 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:21:38.437159 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9e257ddb-6577-4e6d-a43d-2c8047660559 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:38.439327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9e257ddb-6577-4e6d-a43d-2c8047660559 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:38.446588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e257ddb-6577-4e6d-a43d-2c8047660559 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.447034 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e257ddb-6577-4e6d-a43d-2c8047660559 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.447793 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e257ddb-6577-4e6d-a43d-2c8047660559 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.448223 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e257ddb-6577-4e6d-a43d-2c8047660559 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.452019 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:38.480570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9e257ddb-6577-4e6d-a43d-2c8047660559 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047425 Jul 28 09:21:38.481113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 488/950] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:21:38 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:21:38.542343 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2286ee75-80dc-4f62-81b3-835832adaab0 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:38.542842 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2286ee75-80dc-4f62-81b3-835832adaab0 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:38.548932 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2286ee75-80dc-4f62-81b3-835832adaab0 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.549382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2286ee75-80dc-4f62-81b3-835832adaab0 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.550212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2286ee75-80dc-4f62-81b3-835832adaab0 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.550673 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2286ee75-80dc-4f62-81b3-835832adaab0 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.564342 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:38.564947 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:38.571268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.571717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.572469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.572901 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.575508 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2286ee75-80dc-4f62-81b3-835832adaab0 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:21:38.652491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2286ee75-80dc-4f62-81b3-835832adaab0 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 204 len: 0 microversion: 2.1 time: 0.113732 Jul 28 09:21:38.653076 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 463/951] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:21:38 2022] DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:21:38.661275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0e562a30-9253-46ac-9ecb-c4a0838f2e89 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:38.662697 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0e562a30-9253-46ac-9ecb-c4a0838f2e89 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:38.668573 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e562a30-9253-46ac-9ecb-c4a0838f2e89 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.669026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e562a30-9253-46ac-9ecb-c4a0838f2e89 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.669786 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e562a30-9253-46ac-9ecb-c4a0838f2e89 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:38.670284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0e562a30-9253-46ac-9ecb-c4a0838f2e89 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:38.675168 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:38.702815 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:38.711287 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:38.713001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:38.714195 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-18fbe135-cfd6-4d6d-b8c7-f5fb1933e2b0 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.153634 Jul 28 09:21:38.714962 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 489/952] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:38 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:21:38.817498 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0e562a30-9253-46ac-9ecb-c4a0838f2e89 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:38.826030 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0e562a30-9253-46ac-9ecb-c4a0838f2e89 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1672 microversion: 2.1 time: 0.168643 Jul 28 09:21:38.826587 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 464/953] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:38 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:21:39.738082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:39.738688 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:39.745207 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:39.745652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:39.746443 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:39.746879 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:39.847293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1c5af0cc-f264-4089-9df7-b074c225add8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:39.847907 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1c5af0cc-f264-4089-9df7-b074c225add8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:39.855054 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c5af0cc-f264-4089-9df7-b074c225add8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:39.855504 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c5af0cc-f264-4089-9df7-b074c225add8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:39.856269 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c5af0cc-f264-4089-9df7-b074c225add8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:39.856704 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c5af0cc-f264-4089-9df7-b074c225add8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:39.872721 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:39.881126 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:39.882664 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:39.883867 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4efc732f-2de5-46c6-b352-bfc7a1928a55 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1729 microversion: 2.20 time: 0.149836 Jul 28 09:21:39.884424 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 490/954] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:39 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:39.986605 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1c5af0cc-f264-4089-9df7-b074c225add8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:39.995124 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1c5af0cc-f264-4089-9df7-b074c225add8 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1672 microversion: 2.1 time: 0.151578 Jul 28 09:21:39.996012 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 465/955] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:39 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:21:40.907379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:40.907985 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:40.914543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:40.915000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:40.915701 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:40.916135 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:41.017389 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-601148a9-a3ed-48c2-aeb9-3152e6d2c5b3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:41.018023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-601148a9-a3ed-48c2-aeb9-3152e6d2c5b3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:41.025452 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-601148a9-a3ed-48c2-aeb9-3152e6d2c5b3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:41.025829 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-601148a9-a3ed-48c2-aeb9-3152e6d2c5b3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:41.026634 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-601148a9-a3ed-48c2-aeb9-3152e6d2c5b3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:41.027068 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-601148a9-a3ed-48c2-aeb9-3152e6d2c5b3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:41.167919 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:41.176015 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:41.178156 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:41.179401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ed6dcd25-087b-4552-b4d0-668a0e30584f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1716 microversion: 2.20 time: 0.275902 Jul 28 09:21:41.179960 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 491/956] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:21:40 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1716 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:21:41.296896 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-601148a9-a3ed-48c2-aeb9-3152e6d2c5b3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:41.304848 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-601148a9-a3ed-48c2-aeb9-3152e6d2c5b3 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1672 microversion: 2.1 time: 0.291417 Jul 28 09:21:41.305416 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 466/957] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:41 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1672 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:21:41.924572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-ea30caee-7a7d-48ec-94bd-bf8cdb50e1f1 req-971b850e-da02-4fb8-8c3f-b941123f8185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e094080e-3ffb-4929-bccd-2c882dfe6e39", "name": "network-vif-deleted", "tag": "181e3f00-cd4e-4b11-be21-d4ab1e443feb"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:41.936143 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ea30caee-7a7d-48ec-94bd-bf8cdb50e1f1 req-971b850e-da02-4fb8-8c3f-b941123f8185 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:41.936601 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ea30caee-7a7d-48ec-94bd-bf8cdb50e1f1 req-971b850e-da02-4fb8-8c3f-b941123f8185 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:41.948614 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-ea30caee-7a7d-48ec-94bd-bf8cdb50e1f1 req-971b850e-da02-4fb8-8c3f-b941123f8185 service nova] Creating event network-vif-deleted:181e3f00-cd4e-4b11-be21-d4ab1e443feb for instance e094080e-3ffb-4929-bccd-2c882dfe6e39 on hv-cinder-85124 Jul 28 09:21:41.954003 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-ea30caee-7a7d-48ec-94bd-bf8cdb50e1f1 req-971b850e-da02-4fb8-8c3f-b941123f8185 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032801 Jul 28 09:21:41.954678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 492/958] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:42.326889 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:42.327589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:42.334413 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:42.334955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:42.335727 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:42.336166 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:42.372273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:42.372732 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:42.373195 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lazy-loading 'fault' on Instance uuid e094080e-3ffb-4929-bccd-2c882dfe6e39 {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:21:42.428977 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87b166b84ccd4300a1b862d375c137a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5e309462a425a92e550dd2c72ca4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:21:42.437508 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-885bad22-c96e-4ab9-95bc-25acd8b9d810 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 200 len: 1327 microversion: 2.1 time: 0.114511 Jul 28 09:21:42.438123 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 467/959] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:42 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:21:43.460066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:43.460761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:43.467508 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:43.467957 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:43.468718 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:43.469155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:43.482830 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] HTTP exception thrown: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Request method failure captured: Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 HTTP/1.1 Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lLBxSCg9RydU9l1gfKHb5it06nm7fnTP-LKF6Le0jY8e6vLAsNnTivthLW8dj0NgfKIqCoJQiPjZV_VzppZMmAi0rUj2IHoCBuWThYPkfFnC1J4eapCaNCWhN76WNvFXUFQClifJJqeKHHnjzdUR1qy3imNJGaOvja5no1nrsQKDA4 Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:21:43.484477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7b5e309462a425a92e550dd2c72ca4d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}] Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: 87b166b84ccd4300a1b862d375c137a5 Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:43.486128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'e094080e-3ffb-4929-bccd-2c882dfe6e39'} Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:21:43.487062 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:43.488572 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:43.490279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Returning 404 to user: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:21:43.490279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e74493ab-2971-4a75-b4bd-0221706fe1d6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 404 len: 111 microversion: 2.1 time: 0.030775 Jul 28 09:21:43.490279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 493/960] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:43 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:21:43.495116 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b7989c6a-cec8-43aa-a7bd-972c1741eda6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '.version_select at 0x7fd6bf7a0670>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:43.514323 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b7989c6a-cec8-43aa-a7bd-972c1741eda6 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568218549" status: 202 len: 0 microversion: 2.1 time: 0.022904 Jul 28 09:21:43.514888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 468/961] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 09:21:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568218549 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:21:46.370325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:46.370832 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:46.377206 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:46.377649 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:46.378434 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:46.378869 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:46.392592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] HTTP exception thrown: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Request method failure captured: Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 HTTP/1.1 Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lLBxSCg9RydU9l1gfKHb5it06nm7fnTP-LKF6Le0jY8e6vLAsNnTivthLW8dj0NgfKIqCoJQiPjZV_VzppZMmAi0rUj2IHoCBuWThYPkfFnC1J4eapCaNCWhN76WNvFXUFQClifJJqeKHHnjzdUR1qy3imNJGaOvja5no1nrsQKDA4 Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:21:46.394134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7b5e309462a425a92e550dd2c72ca4d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}] Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: 87b166b84ccd4300a1b862d375c137a5 Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.395713 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'e094080e-3ffb-4929-bccd-2c882dfe6e39'} Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:21:46.396992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.398441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.399962 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Returning 404 to user: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:21:46.399962 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6fe4fcff-9e66-4062-950c-754b898f5e46 tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 404 len: 111 microversion: 2.1 time: 0.029069 Jul 28 09:21:46.399962 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 494/962] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:21:46 2022] DELETE /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:21:46.405331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:46.406032 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: e094080e-3ffb-4929-bccd-2c882dfe6e39] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:46.415383 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:46.415883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:46.417402 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:46.417876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:46.430748 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] HTTP exception thrown: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Request method failure captured: Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 HTTP/1.1 Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLBxSCg9RydU9l1gfKHb5it06nm7fnTP-LKF6Le0jY8e6vLAsNnTivthLW8dj0NgfKIqCoJQiPjZV_VzppZMmAi0rUj2IHoCBuWThYPkfFnC1J4eapCaNCWhN76WNvFXUFQClifJJqeKHHnjzdUR1qy3imNJGaOvja5no1nrsQKDA4 Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:21:46.432381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7b5e309462a425a92e550dd2c72ca4d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}] Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 87b166b84ccd4300a1b862d375c137a5 Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.433938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'e094080e-3ffb-4929-bccd-2c882dfe6e39'} Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:21:46.434742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. Jul 28 09:21:46.435888 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:46.436963 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Returning 404 to user: Instance e094080e-3ffb-4929-bccd-2c882dfe6e39 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:21:46.436963 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-aeb98abe-52aa-4189-afcb-ddd60e0b61fc tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39" status: 404 len: 111 microversion: 2.1 time: 0.032301 Jul 28 09:21:46.436963 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 469/963] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:46 2022] GET /compute/v2.1/servers/e094080e-3ffb-4929-bccd-2c882dfe6e39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:21:47.569681 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:47.570216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:47.576677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:47.577120 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:47.577893 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:47.578328 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:47.592216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] HTTP exception thrown: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Request method failure captured: Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 HTTP/1.1 Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lLBxSCg9RydU9l1gfKHb5it06nm7fnTP-LKF6Le0jY8e6vLAsNnTivthLW8dj0NgfKIqCoJQiPjZV_VzppZMmAi0rUj2IHoCBuWThYPkfFnC1J4eapCaNCWhN76WNvFXUFQClifJJqeKHHnjzdUR1qy3imNJGaOvja5no1nrsQKDA4 Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:21:47.593729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7b5e309462a425a92e550dd2c72ca4d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}] Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: 87b166b84ccd4300a1b862d375c137a5 Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.595341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': '6936b19d-2a6d-4b60-a88f-549320d81537'} Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:21:47.596230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.597678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.599096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Returning 404 to user: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:21:47.599096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-af543660-caef-4cab-893e-953960f4559f tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 404 len: 111 microversion: 2.1 time: 0.029754 Jul 28 09:21:47.599096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 495/964] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:21:47 2022] DELETE /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:21:47.603408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:47.604014 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] [instance: 6936b19d-2a6d-4b60-a88f-549320d81537] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:21:47.611103 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:47.611547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:47.612307 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:21:47.612737 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:21:47.626419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] HTTP exception thrown: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Request method failure captured: Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 HTTP/1.1 Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLBxSCg9RydU9l1gfKHb5it06nm7fnTP-LKF6Le0jY8e6vLAsNnTivthLW8dj0NgfKIqCoJQiPjZV_VzppZMmAi0rUj2IHoCBuWThYPkfFnC1J4eapCaNCWhN76WNvFXUFQClifJJqeKHHnjzdUR1qy3imNJGaOvja5no1nrsQKDA4 Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:21:47.627933 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7b5e309462a425a92e550dd2c72ca4d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7b5e309462a425a92e550dd2c72ca4d"}]}] Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: b7b5e309462a425a92e550dd2c72ca4d Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2732882 Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: 87b166b84ccd4300a1b862d375c137a5 Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeTestJSON-2732882-project Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.629436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '6936b19d-2a6d-4b60-a88f-549320d81537'} Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:21:47.630929 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. Jul 28 09:21:47.632487 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:21:47.633989 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] Returning 404 to user: Instance 6936b19d-2a6d-4b60-a88f-549320d81537 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:21:47.633989 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ae0b0318-6855-42f6-a67b-47e46935b1df tempest-AttachVolumeTestJSON-2732882 tempest-AttachVolumeTestJSON-2732882-project] 10.222.0.48 "GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537" status: 404 len: 111 microversion: 2.1 time: 0.029802 Jul 28 09:21:47.633989 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 470/965] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:21:47 2022] GET /compute/v2.1/servers/6936b19d-2a6d-4b60-a88f-549320d81537 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:21:51.904175 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-137e341d-ec1e-4179-8c26-29add365c5d2 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Action: 'create', calling method: .version_select at 0x7fd6c7677550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1397044142", "metadata": {"Type": "work"}}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:21:52.192095 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-137e341d-ec1e-4179-8c26-29add365c5d2 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.408096 Jul 28 09:21:52.192952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 496/966] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Jul 28 09:21:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 410 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 09:21:52.205164 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-74039061-2c8b-4f16-b120-6be91b6b1fc9 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Calling method '.version_select at 0x7fd6c413b280>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:52.257081 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-74039061-2c8b-4f16-b120-6be91b6b1fc9 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb" status: 200 len: 353 microversion: 2.1 time: 0.055717 Jul 28 09:21:52.257650 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 471/967] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:21:52 2022] GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:53.271848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5086e79a-1c62-4746-b604-fc6a1235de37 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Calling method '.version_select at 0x7fd6c76f3c10>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:53.318388 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5086e79a-1c62-4746-b604-fc6a1235de37 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb" status: 200 len: 354 microversion: 2.1 time: 0.051295 Jul 28 09:21:53.318997 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 497/968] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:21:53 2022] GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:53.331441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-61c3ede5-6492-48cd-b33a-f4fc848c839a tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Calling method '.version_select at 0x7fd6bf7a0ca0>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:53.377229 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-61c3ede5-6492-48cd-b33a-f4fc848c839a tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb" status: 200 len: 354 microversion: 2.1 time: 0.050107 Jul 28 09:21:53.377794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 472/969] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:21:53 2022] GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:53.395485 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ef839e31-9be7-4b7e-949b-89226c408021 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Calling method '.version_select at 0x7fd6c7677ca0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:53.455370 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ef839e31-9be7-4b7e-949b-89226c408021 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb" status: 202 len: 0 microversion: 2.1 time: 0.063681 Jul 28 09:21:53.455936 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 498/970] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:21:53 2022] DELETE /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:21:53.464742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-65d358c4-898e-4972-a8b1-71b8e7e15a85 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Calling method '.version_select at 0x7fd6bf7bbe50>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:53.513051 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-65d358c4-898e-4972-a8b1-71b8e7e15a85 tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb" status: 200 len: 353 microversion: 2.1 time: 0.052075 Jul 28 09:21:53.513623 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 473/971] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:21:53 2022] GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:21:54.526843 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e0337c9a-6339-4f32-80e0-768764cfa5fe tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Calling method '.version_select at 0x7fd6c765e550>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:54.554128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-e0337c9a-6339-4f32-80e0-768764cfa5fe tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] HTTP exception thrown: Volume cbb6df38-a35b-4364-96fb-2636596d77bb could not be found. Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e0337c9a-6339-4f32-80e0-768764cfa5fe tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Request method failure captured: Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb HTTP/1.1 Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lUvGG_eCkkGh_fZZiCp-7Qud2Lw3LSbO7SUMi-UiK__Qklei4RsQ5-WSl9VEz1zkRxv7_b4G70Y5qHYm3bXda7kFT6Jnnhp6Crtyr7ApPNNHgWm5o4hPMwXEACBeLy6HvnyAxY_3N0CjnW6YCbJXLk-695O8xnOxsJxmkooR92o4FA Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: cdede8a0184746b7ad130e3a305e337d Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesGetTestJSON-1686023781 Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:21:54.556066 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cdede8a0184746b7ad130e3a305e337d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cdede8a0184746b7ad130e3a305e337d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cdede8a0184746b7ad130e3a305e337d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cdede8a0184746b7ad130e3a305e337d"}]}] Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-VolumesGetTestJSON-1686023781 Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: cdede8a0184746b7ad130e3a305e337d Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesGetTestJSON-1686023781 Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-VolumesGetTestJSON-1686023781-project Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: 96836fdc7c6b4989a362112db17e672f Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-VolumesGetTestJSON-1686023781-project Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Volume cbb6df38-a35b-4364-96fb-2636596d77bb could not be found. Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'cbb6df38-a35b-4364-96fb-2636596d77bb'} Jul 28 09:21:54.557616 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cbb6df38-a35b-4364-96fb-2636596d77bb could not be found. (HTTP 404) (Request-ID: req-398a2a89-14cd-4dee-9e74-ab9c3ef89c65) Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:54.558619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 09:21:54.560016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cbb6df38-a35b-4364-96fb-2636596d77bb could not be found. Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 09:21:54.561473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cbb6df38-a35b-4364-96fb-2636596d77bb could not be found. Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cbb6df38-a35b-4364-96fb-2636596d77bb could not be found. Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e0337c9a-6339-4f32-80e0-768764cfa5fe tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] Returning 404 to user: Volume cbb6df38-a35b-4364-96fb-2636596d77bb could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e0337c9a-6339-4f32-80e0-768764cfa5fe tempest-VolumesGetTestJSON-1686023781 tempest-VolumesGetTestJSON-1686023781-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb" status: 404 len: 109 microversion: 2.1 time: 0.034940 Jul 28 09:21:54.562859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 499/972] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:21:54 2022] GET /compute/v2.1/os-volumes/cbb6df38-a35b-4364-96fb-2636596d77bb => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:27.245430 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:27.247235 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=29 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:27.767026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a5d99c5c-8917-456c-b959-02f6b59c60dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:27.768544 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a5d99c5c-8917-456c-b959-02f6b59c60dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:27.784583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5d99c5c-8917-456c-b959-02f6b59c60dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:27.785832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5d99c5c-8917-456c-b959-02f6b59c60dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:27.787143 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5d99c5c-8917-456c-b959-02f6b59c60dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:27.787909 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5d99c5c-8917-456c-b959-02f6b59c60dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:27.831530 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a5d99c5c-8917-456c-b959-02f6b59c60dd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/ips" status: 200 len: 150 microversion: 2.1 time: 0.592484 Jul 28 09:22:27.832843 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 474/973] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 09:22:27 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/ips => generated 150 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:29.648057 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=35 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:29.650218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=30 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:29.664249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f771258b-2552-4774-8256-6f09b4e8f97f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2edefbf-d19d-4353-862e-90c2169c45e8"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:22:29.672107 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f771258b-2552-4774-8256-6f09b4e8f97f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:29.701022 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f771258b-2552-4774-8256-6f09b4e8f97f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:29.706989 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f771258b-2552-4774-8256-6f09b4e8f97f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:29.708197 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f771258b-2552-4774-8256-6f09b4e8f97f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:29.709164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f771258b-2552-4774-8256-6f09b4e8f97f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:30.391245 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f771258b-2552-4774-8256-6f09b4e8f97f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "POST /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747273 Jul 28 09:22:30.392523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 500/974] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:22:29 2022] POST /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:31.338095 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9b8e6dff-df2b-4dc1-9c86-47dd63607cb6 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Action: 'create', calling method: .version_select at 0x7fd6c7693670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-105365110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+wMk5Ozr4+nZ9L45aorqAZoWql63SVsYITp9Hj1M9wx6T32k+hIS+J4J5bKagp3z0XCeJeSKlaeD2Fqmp1Cw1pscz0l0JDGxpsblY2fWxaG+Ei9a26ZPbsqmtb9Ec3lQ=="}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:22:31.355019 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-9b8e6dff-df2b-4dc1-9c86-47dd63607cb6 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Getting quotas for project b688d320376c4492b3ca97b95c5207a5. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:22:31.359257 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-9b8e6dff-df2b-4dc1-9c86-47dd63607cb6 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Getting quotas for user f56d3e6849ff4268a03ef67c8cf0f813 and project b688d320376c4492b3ca97b95c5207a5. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:22:31.411108 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9b8e6dff-df2b-4dc1-9c86-47dd63607cb6 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.221345 Jul 28 09:22:31.412279 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 475/975] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:22:31 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:38.185637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-da8a82bd-8cff-4c91-b073-cd3f40b441cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:38.186408 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-da8a82bd-8cff-4c91-b073-cd3f40b441cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:38.192707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-da8a82bd-8cff-4c91-b073-cd3f40b441cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:38.193340 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-da8a82bd-8cff-4c91-b073-cd3f40b441cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:38.194332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-da8a82bd-8cff-4c91-b073-cd3f40b441cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:38.195376 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-da8a82bd-8cff-4c91-b073-cd3f40b441cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:38.278898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-da8a82bd-8cff-4c91-b073-cd3f40b441cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lazy-loading 'services' on Instance uuid cef10647-3c4a-4486-982f-b243da6f352c {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:22:38.358478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-da8a82bd-8cff-4c91-b073-cd3f40b441cd tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-volume_attachments/e2edefbf-d19d-4353-862e-90c2169c45e8" status: 202 len: 0 microversion: 2.1 time: 0.177705 Jul 28 09:22:38.359227 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 501/976] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:22:38 2022] DELETE /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-volume_attachments/e2edefbf-d19d-4353-862e-90c2169c45e8 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:22:38.365524 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=4 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:38.371525 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-94c48226-388c-46cb-80e8-c1b9bb10aed2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:38.374013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-94c48226-388c-46cb-80e8-c1b9bb10aed2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:38.381665 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94c48226-388c-46cb-80e8-c1b9bb10aed2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:38.382166 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94c48226-388c-46cb-80e8-c1b9bb10aed2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:38.382947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94c48226-388c-46cb-80e8-c1b9bb10aed2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:38.383381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94c48226-388c-46cb-80e8-c1b9bb10aed2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:38.415188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-94c48226-388c-46cb-80e8-c1b9bb10aed2 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049209 Jul 28 09:22:38.415188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 476/977] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:22:38 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:22:39.427982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b6f06a62-31ca-4dc9-815d-c53a08c83f13 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:39.430387 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b6f06a62-31ca-4dc9-815d-c53a08c83f13 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:39.437069 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b6f06a62-31ca-4dc9-815d-c53a08c83f13 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:39.437517 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b6f06a62-31ca-4dc9-815d-c53a08c83f13 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:39.438304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b6f06a62-31ca-4dc9-815d-c53a08c83f13 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:39.438737 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b6f06a62-31ca-4dc9-815d-c53a08c83f13 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:39.469365 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b6f06a62-31ca-4dc9-815d-c53a08c83f13 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045762 Jul 28 09:22:39.470015 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 502/978] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:22:39 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:22:39.533805 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3877c5f9-2408-42fc-8d3d-3d4219625c63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:39.534344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3877c5f9-2408-42fc-8d3d-3d4219625c63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:39.543798 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3877c5f9-2408-42fc-8d3d-3d4219625c63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:39.544793 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3877c5f9-2408-42fc-8d3d-3d4219625c63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:39.545883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3877c5f9-2408-42fc-8d3d-3d4219625c63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:39.546542 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3877c5f9-2408-42fc-8d3d-3d4219625c63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:39.575562 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3877c5f9-2408-42fc-8d3d-3d4219625c63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:22:39.671246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3877c5f9-2408-42fc-8d3d-3d4219625c63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 204 len: 0 microversion: 2.1 time: 0.140034 Jul 28 09:22:39.672156 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 477/979] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:22:39 2022] DELETE /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:22:39.687870 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-70dae3bc-9caf-4892-8d68-8593fb7d41e5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:39.688490 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70dae3bc-9caf-4892-8d68-8593fb7d41e5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:39.697207 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70dae3bc-9caf-4892-8d68-8593fb7d41e5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:39.697653 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70dae3bc-9caf-4892-8d68-8593fb7d41e5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:39.698488 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70dae3bc-9caf-4892-8d68-8593fb7d41e5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:39.698928 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70dae3bc-9caf-4892-8d68-8593fb7d41e5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:39.844189 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-70dae3bc-9caf-4892-8d68-8593fb7d41e5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:39.852264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-70dae3bc-9caf-4892-8d68-8593fb7d41e5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1681 microversion: 2.1 time: 0.169373 Jul 28 09:22:39.852814 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 503/980] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:39 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:40.021857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-37f86465-728a-4ad1-bc37-9722ce767e43 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:40.024053 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-37f86465-728a-4ad1-bc37-9722ce767e43 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:40.031016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37f86465-728a-4ad1-bc37-9722ce767e43 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:40.031462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37f86465-728a-4ad1-bc37-9722ce767e43 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:40.032217 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37f86465-728a-4ad1-bc37-9722ce767e43 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:40.032648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-37f86465-728a-4ad1-bc37-9722ce767e43 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:40.067681 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-37f86465-728a-4ad1-bc37-9722ce767e43 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050009 Jul 28 09:22:40.068328 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 478/981] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 09:22:40 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:40.139658 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0b1c3925-3c35-47cf-96ad-e4dfd6bded7a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:40.140160 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0b1c3925-3c35-47cf-96ad-e4dfd6bded7a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:40.146727 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b1c3925-3c35-47cf-96ad-e4dfd6bded7a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:40.146908 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b1c3925-3c35-47cf-96ad-e4dfd6bded7a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:40.147637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b1c3925-3c35-47cf-96ad-e4dfd6bded7a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:40.148091 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b1c3925-3c35-47cf-96ad-e4dfd6bded7a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:40.172540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0b1c3925-3c35-47cf-96ad-e4dfd6bded7a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:22:40.247408 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0b1c3925-3c35-47cf-96ad-e4dfd6bded7a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 204 len: 0 microversion: 2.20 time: 0.112919 Jul 28 09:22:40.247979 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 504/982] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 09:22:40 2022] DELETE /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:22:40.256156 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:40.256769 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:40.262762 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:40.263213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:40.263968 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:40.264401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:40.399508 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:40.407371 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:40.408917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:40.410113 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c4462de2-0a67-4af7-b245-da206dd913c5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.157824 Jul 28 09:22:40.410656 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 479/983] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:22:40 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:22:40.875772 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-394a8a9f-d367-4b8f-8e54-1cf4e8f48fce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:40.876853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-394a8a9f-d367-4b8f-8e54-1cf4e8f48fce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:40.885998 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-394a8a9f-d367-4b8f-8e54-1cf4e8f48fce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:40.886444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-394a8a9f-d367-4b8f-8e54-1cf4e8f48fce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:40.887219 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-394a8a9f-d367-4b8f-8e54-1cf4e8f48fce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:40.887652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-394a8a9f-d367-4b8f-8e54-1cf4e8f48fce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:41.020667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-394a8a9f-d367-4b8f-8e54-1cf4e8f48fce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:41.029271 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-394a8a9f-d367-4b8f-8e54-1cf4e8f48fce tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1681 microversion: 2.1 time: 0.159373 Jul 28 09:22:41.029869 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 505/984] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:40 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:41.434410 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:41.434999 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:41.437381 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=4 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:41.442891 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:41.443344 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:41.444111 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:41.444551 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:41.579955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:41.588776 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:41.590368 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:41.591614 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-df879bd4-2d10-40d8-a384-70897e391549 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.161818 Jul 28 09:22:41.592186 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 480/985] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:22:41 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:22:42.051249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-da149e14-0d78-4a57-803f-2ac3ca52715f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:42.052898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-da149e14-0d78-4a57-803f-2ac3ca52715f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:42.059978 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-da149e14-0d78-4a57-803f-2ac3ca52715f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:42.060562 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-da149e14-0d78-4a57-803f-2ac3ca52715f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:42.061450 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-da149e14-0d78-4a57-803f-2ac3ca52715f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:42.062005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-da149e14-0d78-4a57-803f-2ac3ca52715f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:42.197248 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-da149e14-0d78-4a57-803f-2ac3ca52715f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:42.204825 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-da149e14-0d78-4a57-803f-2ac3ca52715f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1681 microversion: 2.1 time: 0.158012 Jul 28 09:22:42.205389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 506/986] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:42 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:42.615295 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:42.615907 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:42.623007 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:42.623465 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:42.624437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:42.624677 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:42.796008 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:42.804174 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:42.806276 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:42.807435 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-40d0852c-68f8-478e-ad7b-b5e3f3d80a30 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.196112 Jul 28 09:22:42.808190 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 481/987] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:22:42 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:22:43.227214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8813a619-521e-417f-9d22-b5363b469e63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:43.227873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8813a619-521e-417f-9d22-b5363b469e63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:43.234448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8813a619-521e-417f-9d22-b5363b469e63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:43.234904 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8813a619-521e-417f-9d22-b5363b469e63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:43.235668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8813a619-521e-417f-9d22-b5363b469e63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:43.236105 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8813a619-521e-417f-9d22-b5363b469e63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:43.554507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8813a619-521e-417f-9d22-b5363b469e63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:43.562131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8813a619-521e-417f-9d22-b5363b469e63 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1681 microversion: 2.1 time: 0.339281 Jul 28 09:22:43.562988 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 507/988] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:43 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1681 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:43.831730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:43.832345 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:43.840874 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:43.841390 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:43.842275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:43.842791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:44.090698 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:44.099852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:44.101353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:44.103130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-866f9daa-edec-4e55-83e1-6ae9ec966fc5 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1722 microversion: 2.20 time: 0.275702 Jul 28 09:22:44.104003 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 482/989] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:22:43 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:22:44.377224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-65c205b2-90ee-4dd6-8d7c-841a5c146a85 req-256fcee1-e46a-4743-93ab-dc50a6945cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef10647-3c4a-4486-982f-b243da6f352c", "name": "network-vif-deleted", "tag": "1eee53e9-c381-4035-8bc0-2271c557daf3"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:22:44.388897 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-65c205b2-90ee-4dd6-8d7c-841a5c146a85 req-256fcee1-e46a-4743-93ab-dc50a6945cdc service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:44.389576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-65c205b2-90ee-4dd6-8d7c-841a5c146a85 req-256fcee1-e46a-4743-93ab-dc50a6945cdc service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:44.402199 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-65c205b2-90ee-4dd6-8d7c-841a5c146a85 req-256fcee1-e46a-4743-93ab-dc50a6945cdc service nova] Creating event network-vif-deleted:1eee53e9-c381-4035-8bc0-2271c557daf3 for instance cef10647-3c4a-4486-982f-b243da6f352c on hv-cinder-85124 Jul 28 09:22:44.429622 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-65c205b2-90ee-4dd6-8d7c-841a5c146a85 req-256fcee1-e46a-4743-93ab-dc50a6945cdc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055781 Jul 28 09:22:44.431241 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 508/990] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:44.586565 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:44.589530 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:44.596415 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:44.602133 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:44.603322 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:44.604007 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:44.652541 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:44.653385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:44.654082 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lazy-loading 'fault' on Instance uuid cef10647-3c4a-4486-982f-b243da6f352c {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:22:44.707446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c1ed47784c46baa7ddc4abdfc54bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c957cfe3391147daab9fc1e59b414a3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:44.718206 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ef222c4d-81d8-4a37-a755-310ff6828696 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 200 len: 1331 microversion: 2.1 time: 0.137186 Jul 28 09:22:44.733517 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 483/991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:44 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:45.127757 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:45.128457 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:45.134845 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:45.135568 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:45.136330 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:45.136770 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:45.170764 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:45.171215 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:45.171667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lazy-loading 'fault' on Instance uuid bbf9f15d-39b9-4bd4-959f-0406b46dd02d {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:22:45.215885 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:45.224799 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:45.226374 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6f5e471a7ac4218a35ffe1840d91575', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e862416d3ca4d019cd0dd62f439038c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:45.228087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-05584116-65f0-47d5-901c-0ea53a0ce812 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 200 len: 1371 microversion: 2.20 time: 0.104777 Jul 28 09:22:45.228854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 509/992] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:22:45 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:22:45.739992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:45.740606 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:45.747049 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:45.747499 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:45.748262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:45.748701 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:45.761828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c HTTP/1.1 Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:22:45.763468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:45.765114 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'cef10647-3c4a-4486-982f-b243da6f352c'} Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:45.766085 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:45.767601 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:45.769063 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:45.769063 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1f091142-65b2-45d5-b8ba-1cc4e5698b95 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 404 len: 111 microversion: 2.1 time: 0.028791 Jul 28 09:22:45.769063 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 484/993] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:45 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:45.774116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-106f0f6e-03f6-4718-b253-e26f643a4f82 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '.version_select at 0x7fd6c76f0c10>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:45.793145 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-106f0f6e-03f6-4718-b253-e26f643a4f82 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-556334997" status: 202 len: 0 microversion: 2.1 time: 0.023303 Jul 28 09:22:45.793722 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 510/994] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 09:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-556334997 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:22:46.252243 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:46.252756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:46.259642 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:46.260176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:46.260961 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:46.261445 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:46.275733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] HTTP exception thrown: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Request method failure captured: Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d HTTP/1.1 Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLBcBBsNPfKHFauhH-ovzSZnFi5Aja5CbhFTPUdJPw7Nno6Lt5J6ROL2LCIeEXPVmv8rpSqhtmXhLNbrvr_O5dY05kUPQ-Sr4wAGFOGHNZ3ixlAcT3hJZQpS6nWzd0Hn06tYSBdz0TqVjntf9OOauN2cQKin-TINVPjpmD-U9Gtd50 Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:22:46.277262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e862416d3ca4d019cd0dd62f439038c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}] Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: a6f5e471a7ac4218a35ffe1840d91575 Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:46.278912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'bbf9f15d-39b9-4bd4-959f-0406b46dd02d'} Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:46.279790 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:46.281212 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:46.282492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Returning 404 to user: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:46.282492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7b186be6-4f7a-4c12-8f61-4e7c3b654a53 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 404 len: 111 microversion: 2.20 time: 0.030463 Jul 28 09:22:46.282492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 485/995] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:22:46 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:22:46.291584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d1bb09f9-1db8-4034-a9d6-a0aecbdf403f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '.version_select at 0x7fd6c767bca0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:46.311219 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d1bb09f9-1db8-4034-a9d6-a0aecbdf403f tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-156990400" status: 204 len: 0 microversion: 2.20 time: 0.023601 Jul 28 09:22:46.311995 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 511/996] 10.222.0.48 () {60 vars in 1259 bytes} [Thu Jul 28 09:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-156990400 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:22:46.454453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-362bcee2-7e72-4872-b397-275338717abc req-a1b3e252-2f19-4068-80f3-9360dccc9be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf9f15d-39b9-4bd4-959f-0406b46dd02d", "name": "network-vif-deleted", "tag": "760da6e1-e95d-4104-b4c2-bc4781aafac6"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:22:46.465185 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-362bcee2-7e72-4872-b397-275338717abc req-a1b3e252-2f19-4068-80f3-9360dccc9be6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:46.465727 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-362bcee2-7e72-4872-b397-275338717abc req-a1b3e252-2f19-4068-80f3-9360dccc9be6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:46.482521 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-362bcee2-7e72-4872-b397-275338717abc req-a1b3e252-2f19-4068-80f3-9360dccc9be6 service nova] Creating event network-vif-deleted:760da6e1-e95d-4104-b4c2-bc4781aafac6 for instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d on hv-cinder-85124 Jul 28 09:22:46.487869 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-362bcee2-7e72-4872-b397-275338717abc req-a1b3e252-2f19-4068-80f3-9360dccc9be6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037180 Jul 28 09:22:46.488800 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 486/997] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:47.823840 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:47.824437 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:47.830293 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:47.830740 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:47.831500 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:47.831936 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:47.845711 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c HTTP/1.1 Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:22:47.847311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.848889 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'cef10647-3c4a-4486-982f-b243da6f352c'} Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:47.849833 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.851267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.853250 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:47.853250 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9da58f15-0cfb-4221-9c0f-53274dd43594 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 404 len: 111 microversion: 2.1 time: 0.029245 Jul 28 09:22:47.853250 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 512/998] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:22:47 2022] DELETE /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:47.858677 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:47.859366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: cef10647-3c4a-4486-982f-b243da6f352c] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:47.865401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:47.865862 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:47.866626 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:47.867056 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:47.879856 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c HTTP/1.1 Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:22:47.881422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.883024 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'cef10647-3c4a-4486-982f-b243da6f352c'} Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:47.883924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. Jul 28 09:22:47.885528 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:47.886887 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance cef10647-3c4a-4486-982f-b243da6f352c could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:47.886887 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e0d7bf4e-8060-437c-93e1-f1aafcf8f8c5 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c" status: 404 len: 111 microversion: 2.1 time: 0.028820 Jul 28 09:22:47.886887 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 487/999] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:47 2022] GET /compute/v2.1/servers/cef10647-3c4a-4486-982f-b243da6f352c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:48.318204 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:48.318726 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:48.325391 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:48.325857 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:48.326633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:48.327068 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:48.341444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] HTTP exception thrown: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Request method failure captured: Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d HTTP/1.1 Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lLBcBBsNPfKHFauhH-ovzSZnFi5Aja5CbhFTPUdJPw7Nno6Lt5J6ROL2LCIeEXPVmv8rpSqhtmXhLNbrvr_O5dY05kUPQ-Sr4wAGFOGHNZ3ixlAcT3hJZQpS6nWzd0Hn06tYSBdz0TqVjntf9OOauN2cQKin-TINVPjpmD-U9Gtd50 Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:22:48.342991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e862416d3ca4d019cd0dd62f439038c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}] Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: a6f5e471a7ac4218a35ffe1840d91575 Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.344854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'bbf9f15d-39b9-4bd4-959f-0406b46dd02d'} Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:48.345632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.346861 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.348230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Returning 404 to user: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:48.348230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1e5e7075-453b-4c66-8d7e-46ac6220a2af tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 404 len: 111 microversion: 2.20 time: 0.030209 Jul 28 09:22:48.348230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 513/1000] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 09:22:48 2022] DELETE /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:22:48.353473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:48.354224 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: bbf9f15d-39b9-4bd4-959f-0406b46dd02d] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:48.361068 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:48.361618 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:48.362500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:48.362936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:48.376893 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] HTTP exception thrown: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Request method failure captured: Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d HTTP/1.1 Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLBcBBsNPfKHFauhH-ovzSZnFi5Aja5CbhFTPUdJPw7Nno6Lt5J6ROL2LCIeEXPVmv8rpSqhtmXhLNbrvr_O5dY05kUPQ-Sr4wAGFOGHNZ3ixlAcT3hJZQpS6nWzd0Hn06tYSBdz0TqVjntf9OOauN2cQKin-TINVPjpmD-U9Gtd50 Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:22:48.378730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e862416d3ca4d019cd0dd62f439038c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}] Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: a6f5e471a7ac4218a35ffe1840d91575 Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.380198 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'bbf9f15d-39b9-4bd4-959f-0406b46dd02d'} Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:48.380906 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. Jul 28 09:22:48.382107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:48.383724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Returning 404 to user: Instance bbf9f15d-39b9-4bd4-959f-0406b46dd02d could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:48.383724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-516c820a-a7b4-4303-9a1a-775d7f72e606 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d" status: 404 len: 111 microversion: 2.20 time: 0.030538 Jul 28 09:22:48.383724 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 488/1001] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:22:48 2022] GET /compute/v2.1/servers/bbf9f15d-39b9-4bd4-959f-0406b46dd02d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:22:49.021434 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:49.022014 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:49.028697 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.029153 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.029938 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.030379 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.043931 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 HTTP/1.1 Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:22:49.045505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.046926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': '30f89173-0824-45dd-bdf5-c5af808a7dd2'} Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:49.047710 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.048956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.050231 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:49.050231 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aa8f6f7a-6733-4330-ab46-87abf643528c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 404 len: 111 microversion: 2.1 time: 0.030035 Jul 28 09:22:49.050231 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 514/1002] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:22:49 2022] DELETE /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:49.056748 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:49.057375 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 30f89173-0824-45dd-bdf5-c5af808a7dd2] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:49.064556 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.065150 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.066100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.066734 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.081919 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 HTTP/1.1 Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:22:49.083441 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.085339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '30f89173-0824-45dd-bdf5-c5af808a7dd2'} Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:49.087036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. Jul 28 09:22:49.089342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.090745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance 30f89173-0824-45dd-bdf5-c5af808a7dd2 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:49.090745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-158a9c9e-5007-4a34-8822-eb39ee0d6e3c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2" status: 404 len: 111 microversion: 2.1 time: 0.033408 Jul 28 09:22:49.090745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 489/1003] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:49 2022] GET /compute/v2.1/servers/30f89173-0824-45dd-bdf5-c5af808a7dd2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:49.093770 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:49.094287 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:49.100415 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.100862 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.101612 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.102696 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.116232 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 HTTP/1.1 Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:22:49.118405 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.120335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': '886e113b-47d9-4760-bf0d-d5a2901b61f3'} Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:49.121523 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.123325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.124943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:49.124943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-55efc417-0bab-4e71-abc7-85f2ce12894f tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 404 len: 111 microversion: 2.1 time: 0.029751 Jul 28 09:22:49.124943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 515/1004] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:22:49 2022] DELETE /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:49.128211 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:49.128800 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: 886e113b-47d9-4760-bf0d-d5a2901b61f3] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:49.135159 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.135603 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.136348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.136775 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.149891 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 HTTP/1.1 Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:22:49.151589 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.152946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '886e113b-47d9-4760-bf0d-d5a2901b61f3'} Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:49.153671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. Jul 28 09:22:49.155037 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.156282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance 886e113b-47d9-4760-bf0d-d5a2901b61f3 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:49.156282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-07c1e205-c1e4-499b-abea-5dac72db8636 tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3" status: 404 len: 111 microversion: 2.1 time: 0.028735 Jul 28 09:22:49.156282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 490/1005] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:49 2022] GET /compute/v2.1/servers/886e113b-47d9-4760-bf0d-d5a2901b61f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:22:49.519139 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:49.519659 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:49.526589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.527040 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.527800 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.528231 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.543669 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] HTTP exception thrown: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Request method failure captured: Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 HTTP/1.1 Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lLBcBBsNPfKHFauhH-ovzSZnFi5Aja5CbhFTPUdJPw7Nno6Lt5J6ROL2LCIeEXPVmv8rpSqhtmXhLNbrvr_O5dY05kUPQ-Sr4wAGFOGHNZ3ixlAcT3hJZQpS6nWzd0Hn06tYSBdz0TqVjntf9OOauN2cQKin-TINVPjpmD-U9Gtd50 Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:22:49.545216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e862416d3ca4d019cd0dd62f439038c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}] Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: a6f5e471a7ac4218a35ffe1840d91575 Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.546898 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': '145d502e-eb34-435a-8b8c-2ea6264d1506'} Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:49.547736 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.548943 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.550185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Returning 404 to user: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:49.550185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-14053d0f-e246-4976-8ec3-c02bcf05025a tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 404 len: 111 microversion: 2.20 time: 0.031375 Jul 28 09:22:49.550185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 516/1006] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 09:22:49 2022] DELETE /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:22:49.555446 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:49.556064 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] [instance: 145d502e-eb34-435a-8b8c-2ea6264d1506] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:49.562023 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.562468 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.563216 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:49.563674 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:49.577755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] HTTP exception thrown: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Request method failure captured: Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 HTTP/1.1 Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lLBcBBsNPfKHFauhH-ovzSZnFi5Aja5CbhFTPUdJPw7Nno6Lt5J6ROL2LCIeEXPVmv8rpSqhtmXhLNbrvr_O5dY05kUPQ-Sr4wAGFOGHNZ3ixlAcT3hJZQpS6nWzd0Hn06tYSBdz0TqVjntf9OOauN2cQKin-TINVPjpmD-U9Gtd50 Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:22:49.579297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e862416d3ca4d019cd0dd62f439038c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e862416d3ca4d019cd0dd62f439038c"}]}] Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 6e862416d3ca4d019cd0dd62f439038c Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-216723217 Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: a6f5e471a7ac4218a35ffe1840d91575 Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-216723217-project Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.580912 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '145d502e-eb34-435a-8b8c-2ea6264d1506'} Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:49.581876 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. Jul 28 09:22:49.583627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:49.585321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] Returning 404 to user: Instance 145d502e-eb34-435a-8b8c-2ea6264d1506 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:49.585321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5c4105de-0a95-40c4-b51a-a3a980e004b9 tempest-AttachVolumeShelveTestJSON-216723217 tempest-AttachVolumeShelveTestJSON-216723217-project] 10.222.0.48 "GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506" status: 404 len: 111 microversion: 2.20 time: 0.029147 Jul 28 09:22:49.585321 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 491/1007] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 09:22:49 2022] GET /compute/v2.1/servers/145d502e-eb34-435a-8b8c-2ea6264d1506 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:22:50.289500 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:50.290046 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:50.296837 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:50.297291 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:50.298080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:50.298528 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:50.313255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc HTTP/1.1 Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:22:50.314827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.316214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'a8bbe522-65b1-4925-9da8-8691bb25acdc'} Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:50.316970 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.318229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.319432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:50.319432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-15564e3f-a8e2-4cec-b9ac-4f99f386d41c tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 404 len: 111 microversion: 2.1 time: 0.030645 Jul 28 09:22:50.319432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 517/1008] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:22:50 2022] DELETE /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:50.325461 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:50.326158 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] [instance: a8bbe522-65b1-4925-9da8-8691bb25acdc] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:50.332816 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:50.333729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:50.334519 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:50.334954 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:50.349066 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] HTTP exception thrown: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Request method failure captured: Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc HTTP/1.1 Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lK_GT9jnqaB1WTcyk7s-Cz0xF7VCx4Y4rym-RSgIT0Ie-UWUUpqoUI83S7tgyC1b1XgWogXAuU1pUUq2u0oCZ8UXqgLukVBF19KIhhVMKxkL065xal4Sn3ukW3Fz4O6FUAA_Dfuifpb1MOZcE1Qd_gsQAKBBqNhi3f_jS5JsnXsyHg Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:22:50.350653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c957cfe3391147daab9fc1e59b414a3e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c957cfe3391147daab9fc1e59b414a3e"}]}] Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: c957cfe3391147daab9fc1e59b414a3e Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344809209 Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: e0c1ed47784c46baa7ddc4abdfc54bbb Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-AttachVolumeNegativeTest-1344809209-project Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.352595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'a8bbe522-65b1-4925-9da8-8691bb25acdc'} Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:22:50.353399 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. Jul 28 09:22:50.354664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:22:50.355725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] Returning 404 to user: Instance a8bbe522-65b1-4925-9da8-8691bb25acdc could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:22:50.355725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dae58b57-e79d-4820-8a60-aaa3bdd6ecfa tempest-AttachVolumeNegativeTest-1344809209 tempest-AttachVolumeNegativeTest-1344809209-project] 10.222.0.48 "GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc" status: 404 len: 111 microversion: 2.1 time: 0.031092 Jul 28 09:22:50.355725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 492/1009] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:50 2022] GET /compute/v2.1/servers/a8bbe522-65b1-4925-9da8-8691bb25acdc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:22:53.749532 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-808467403", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-105365110", "security_groups": [{"name": "tempest-secgroup-smoke-362222153"}], "block_device_mapping_v2": [{"uuid": "8f699dbc-cf26-4607-b420-ab070946f362", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d35f2c27-9c9b-43b1-b077-ba21c954e931"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:22:53.968603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] validate_networks() for [('d35f2c27-9c9b-43b1-b077-ba21c954e931', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:22:54.890886 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:22:54.891635 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:22:54.891842 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:22:54.892641 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:22:54.893224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:22:54.902478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:54.902905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:54.903743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:54.904166 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:54.934252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Getting quotas for project b688d320376c4492b3ca97b95c5207a5. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:22:54.938231 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Getting quotas for user f56d3e6849ff4268a03ef67c8cf0f813 and project b688d320376c4492b3ca97b95c5207a5. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:22:54.998263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:22:55.000347 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f699dbc-cf26-4607-b420-ab070946f362',volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:22:55.132883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-357d4f0b-24ad-486c-aaad-582a61376834 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.387005 Jul 28 09:22:55.133638 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 518/1010] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:22:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:22:55.146219 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d3ddacc8-bc44-4ef7-bac1-1db12d4ae2b4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:55.147390 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d3ddacc8-bc44-4ef7-bac1-1db12d4ae2b4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:55.223210 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d3ddacc8-bc44-4ef7-bac1-1db12d4ae2b4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:55.232158 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d3ddacc8-bc44-4ef7-bac1-1db12d4ae2b4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1093 microversion: 2.1 time: 0.090863 Jul 28 09:22:55.232734 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 493/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:55 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1093 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:55.925145 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a3ed933b-befe-42e4-a997-2f866eb7f186 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c76f3430>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:55.977949 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a3ed933b-befe-42e4-a997-2f866eb7f186 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/976a6d42-bbd0-41bb-96f7-0b771e186ab3" status: 200 len: 350 microversion: 2.1 time: 0.057592 Jul 28 09:22:55.978705 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 519/1012] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:22:55 2022] GET /compute/v2.1/os-volumes/976a6d42-bbd0-41bb-96f7-0b771e186ab3 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:56.253577 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a5be461d-dacc-4893-b96a-70d6d569e692 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:56.255213 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a5be461d-dacc-4893-b96a-70d6d569e692 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:56.264507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5be461d-dacc-4893-b96a-70d6d569e692 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:56.266484 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5be461d-dacc-4893-b96a-70d6d569e692 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:56.272696 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5be461d-dacc-4893-b96a-70d6d569e692 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:56.273216 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a5be461d-dacc-4893-b96a-70d6d569e692 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:56.377272 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a5be461d-dacc-4893-b96a-70d6d569e692 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:56.396451 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a5be461d-dacc-4893-b96a-70d6d569e692 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1191 microversion: 2.1 time: 0.147124 Jul 28 09:22:56.397504 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 494/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:56 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1191 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:57.426116 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-423c20c6-6176-417a-8337-a2cfa7d7fe56 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:57.431651 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-423c20c6-6176-417a-8337-a2cfa7d7fe56 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:57.444561 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-423c20c6-6176-417a-8337-a2cfa7d7fe56 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:57.445298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-423c20c6-6176-417a-8337-a2cfa7d7fe56 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:57.448494 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-423c20c6-6176-417a-8337-a2cfa7d7fe56 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:57.449136 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-423c20c6-6176-417a-8337-a2cfa7d7fe56 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:57.450700 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-25d71dca-1b59-44aa-bed9-6f5813f69270 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c7768ca0>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:57.539242 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-25d71dca-1b59-44aa-bed9-6f5813f69270 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9c1bb4e5-4a44-4070-9058-f893ba02e18d" status: 200 len: 350 microversion: 2.1 time: 0.092366 Jul 28 09:22:57.539823 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 495/1014] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:22:57 2022] GET /compute/v2.1/os-volumes/9c1bb4e5-4a44-4070-9058-f893ba02e18d => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:57.821294 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-423c20c6-6176-417a-8337-a2cfa7d7fe56 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:57.824985 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:57.829691 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-423c20c6-6176-417a-8337-a2cfa7d7fe56 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1276 microversion: 2.1 time: 0.410618 Jul 28 09:22:57.830504 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 520/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:57 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1276 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:58.312798 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-05509d93-e45e-4cb1-836e-e79ba282e435 req-e5e97e20-9473-4d60-9e21-5545b0430d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c938b286-4c8f-4695-b0fc-942f9c573cb9", "tag": "576868e7-d820-4531-a560-9a02eb21a924"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:22:58.320013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:58.331002 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-05509d93-e45e-4cb1-836e-e79ba282e435 req-e5e97e20-9473-4d60-9e21-5545b0430d5e service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:58.331799 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-05509d93-e45e-4cb1-836e-e79ba282e435 req-e5e97e20-9473-4d60-9e21-5545b0430d5e service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:58.346366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-05509d93-e45e-4cb1-836e-e79ba282e435 req-e5e97e20-9473-4d60-9e21-5545b0430d5e service nova] Creating event network-changed:576868e7-d820-4531-a560-9a02eb21a924 for instance c938b286-4c8f-4695-b0fc-942f9c573cb9 on hv-cinder-85124 Jul 28 09:22:58.355450 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-05509d93-e45e-4cb1-836e-e79ba282e435 req-e5e97e20-9473-4d60-9e21-5545b0430d5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054924 Jul 28 09:22:58.356301 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 496/1016] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:22:58.851880 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1c4ac352-ce5e-40ec-964a-2fa72c336e34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:58.853185 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1c4ac352-ce5e-40ec-964a-2fa72c336e34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:22:58.861774 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1c4ac352-ce5e-40ec-964a-2fa72c336e34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:58.862286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1c4ac352-ce5e-40ec-964a-2fa72c336e34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:58.863064 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1c4ac352-ce5e-40ec-964a-2fa72c336e34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:22:58.863503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1c4ac352-ce5e-40ec-964a-2fa72c336e34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:22:59.001070 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-1c4ac352-ce5e-40ec-964a-2fa72c336e34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:22:59.022164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1c4ac352-ce5e-40ec-964a-2fa72c336e34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.165193 Jul 28 09:22:59.022164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 521/1017] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:22:58 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:59.028674 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bba68282-082e-4987-969b-17eb4aed04e3 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c77680d0>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.081652 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bba68282-082e-4987-969b-17eb4aed04e3 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/668657fa-548d-49e7-a099-04e2baf30326" status: 200 len: 351 microversion: 2.1 time: 0.057626 Jul 28 09:22:59.082547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 497/1018] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes/668657fa-548d-49e7-a099-04e2baf30326 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:59.095448 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-88c4e210-a15b-4166-a705-96120bde12df tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c7671b80>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.188931 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-88c4e210-a15b-4166-a705-96120bde12df tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097281 Jul 28 09:22:59.189499 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 522/1019] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:59.203005 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c008358f-912c-4ca9-b3cc-f27f68f86814 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c772bd30>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.288501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c008358f-912c-4ca9-b3cc-f27f68f86814 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089240 Jul 28 09:22:59.289061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 498/1020] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:59.304073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-44a33d57-f5c5-4a3c-ade2-0e009ddb350c tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c76775e0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.425356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-44a33d57-f5c5-4a3c-ade2-0e009ddb350c tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.125532 Jul 28 09:22:59.426089 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 523/1021] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:59.438899 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a6966216-1113-4a9b-9211-fd07a2b2fff6 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6bf78c160>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.525031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a6966216-1113-4a9b-9211-fd07a2b2fff6 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089906 Jul 28 09:22:59.525543 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 499/1022] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:59.542429 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2bbca95e-12af-48a3-8c67-aa90a67bad8d tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c773aaf0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.632252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2bbca95e-12af-48a3-8c67-aa90a67bad8d tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093766 Jul 28 09:22:59.633577 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 524/1023] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:59.650534 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-762cfa35-bb62-4a13-b081-a050e3837086 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6bf647430>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.738972 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-762cfa35-bb62-4a13-b081-a050e3837086 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.094689 Jul 28 09:22:59.739353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 500/1024] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:22:59.761123 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aab498d3-0788-4b92-b8bb-0c1fc3a35d23 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c7677430>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.843164 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aab498d3-0788-4b92-b8bb-0c1fc3a35d23 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093620 Jul 28 09:22:59.843781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 525/1025] 10.222.0.48 () {58 vars in 1188 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:59.858082 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8bda2328-9487-49a3-b770-cc7903eff8e7 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] Calling method '.version_select at 0x7fd6c772bd30>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:59.951939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8bda2328-9487-49a3-b770-cc7903eff8e7 tempest-VolumesTestJSON-763803567 tempest-VolumesTestJSON-763803567-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098378 Jul 28 09:22:59.952569 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 501/1026] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 09:22:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:00.035295 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7ea09b7d-9c68-47a0-bb65-3d7720c96f92 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:00.035295 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7ea09b7d-9c68-47a0-bb65-3d7720c96f92 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:00.044363 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:00.052340 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ea09b7d-9c68-47a0-bb65-3d7720c96f92 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:00.052804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ea09b7d-9c68-47a0-bb65-3d7720c96f92 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:00.053641 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ea09b7d-9c68-47a0-bb65-3d7720c96f92 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:00.058476 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ea09b7d-9c68-47a0-bb65-3d7720c96f92 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:00.365948 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-7ea09b7d-9c68-47a0-bb65-3d7720c96f92 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:00.376972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7ea09b7d-9c68-47a0-bb65-3d7720c96f92 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.347931 Jul 28 09:23:00.377927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 526/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:00 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:01.399577 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-34f1c62f-f9ca-465a-94c4-7f4d95e3addb tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:01.400333 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-34f1c62f-f9ca-465a-94c4-7f4d95e3addb tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:01.407653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-34f1c62f-f9ca-465a-94c4-7f4d95e3addb tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:01.408121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-34f1c62f-f9ca-465a-94c4-7f4d95e3addb tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:01.408926 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-34f1c62f-f9ca-465a-94c4-7f4d95e3addb tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:01.409369 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-34f1c62f-f9ca-465a-94c4-7f4d95e3addb tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:01.579598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-34f1c62f-f9ca-465a-94c4-7f4d95e3addb tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:01.588140 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-34f1c62f-f9ca-465a-94c4-7f4d95e3addb tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.193066 Jul 28 09:23:01.588719 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 502/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:01 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:02.612477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ab03e550-dc83-4962-a8ef-acfe32aca92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:02.614161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ab03e550-dc83-4962-a8ef-acfe32aca92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:02.622320 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab03e550-dc83-4962-a8ef-acfe32aca92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:02.622769 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab03e550-dc83-4962-a8ef-acfe32aca92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:02.623810 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab03e550-dc83-4962-a8ef-acfe32aca92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:02.624298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ab03e550-dc83-4962-a8ef-acfe32aca92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:02.769569 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ab03e550-dc83-4962-a8ef-acfe32aca92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:02.777757 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ab03e550-dc83-4962-a8ef-acfe32aca92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.169896 Jul 28 09:23:02.778365 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 527/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:02 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:03.801061 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-76906109-87c8-410a-b080-e6d269acc330 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:03.802122 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-76906109-87c8-410a-b080-e6d269acc330 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:03.811843 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-76906109-87c8-410a-b080-e6d269acc330 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:03.812512 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-76906109-87c8-410a-b080-e6d269acc330 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:03.813651 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-76906109-87c8-410a-b080-e6d269acc330 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:03.814390 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-76906109-87c8-410a-b080-e6d269acc330 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:04.004164 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-76906109-87c8-410a-b080-e6d269acc330 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:04.011883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-76906109-87c8-410a-b080-e6d269acc330 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.216614 Jul 28 09:23:04.012641 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 503/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:03 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:05.033316 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8a481baf-e2f1-42c2-bb37-dda6f976df12 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:05.033962 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8a481baf-e2f1-42c2-bb37-dda6f976df12 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:05.036335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:05.036938 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:05.043565 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8a481baf-e2f1-42c2-bb37-dda6f976df12 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:05.044090 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8a481baf-e2f1-42c2-bb37-dda6f976df12 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:05.044883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8a481baf-e2f1-42c2-bb37-dda6f976df12 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:05.045356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8a481baf-e2f1-42c2-bb37-dda6f976df12 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:05.188991 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8a481baf-e2f1-42c2-bb37-dda6f976df12 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:05.197084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8a481baf-e2f1-42c2-bb37-dda6f976df12 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.167579 Jul 28 09:23:05.197676 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 528/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:05 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:23:06.220325 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-880835e0-9d50-4263-861d-1c541058ffca tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:06.220923 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-880835e0-9d50-4263-861d-1c541058ffca tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:06.223748 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:06.232730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-880835e0-9d50-4263-861d-1c541058ffca tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:06.233194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-880835e0-9d50-4263-861d-1c541058ffca tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:06.234087 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-880835e0-9d50-4263-861d-1c541058ffca tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:06.234662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-880835e0-9d50-4263-861d-1c541058ffca tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:06.239192 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:06.426175 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-880835e0-9d50-4263-861d-1c541058ffca tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:06.435308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-880835e0-9d50-4263-861d-1c541058ffca tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.219507 Jul 28 09:23:06.435913 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 504/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:06 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:07.455396 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d1ae25b-40a9-44ad-ab91-9c9331dda926 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:07.455999 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8d1ae25b-40a9-44ad-ab91-9c9331dda926 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:07.462561 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d1ae25b-40a9-44ad-ab91-9c9331dda926 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:07.463002 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d1ae25b-40a9-44ad-ab91-9c9331dda926 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:07.463790 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d1ae25b-40a9-44ad-ab91-9c9331dda926 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:07.464286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d1ae25b-40a9-44ad-ab91-9c9331dda926 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:07.620125 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d1ae25b-40a9-44ad-ab91-9c9331dda926 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:07.628468 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8d1ae25b-40a9-44ad-ab91-9c9331dda926 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.176889 Jul 28 09:23:07.629042 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 529/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:07 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:08.650664 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8af17910-a98a-471a-bf14-5d4e2f6390cd tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:08.651273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8af17910-a98a-471a-bf14-5d4e2f6390cd tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:08.657939 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8af17910-a98a-471a-bf14-5d4e2f6390cd tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:08.658473 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8af17910-a98a-471a-bf14-5d4e2f6390cd tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:08.659319 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8af17910-a98a-471a-bf14-5d4e2f6390cd tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:08.659751 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8af17910-a98a-471a-bf14-5d4e2f6390cd tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:08.801734 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8af17910-a98a-471a-bf14-5d4e2f6390cd tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:08.810079 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8af17910-a98a-471a-bf14-5d4e2f6390cd tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.163865 Jul 28 09:23:08.810653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 505/1034] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:08 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:09.831564 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-35442f51-66a8-4779-a6b4-f608f195c864 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:09.832866 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-35442f51-66a8-4779-a6b4-f608f195c864 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:09.840369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35442f51-66a8-4779-a6b4-f608f195c864 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:09.841033 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35442f51-66a8-4779-a6b4-f608f195c864 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:09.841808 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35442f51-66a8-4779-a6b4-f608f195c864 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:09.842268 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-35442f51-66a8-4779-a6b4-f608f195c864 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:09.998152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-35442f51-66a8-4779-a6b4-f608f195c864 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:10.007926 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-35442f51-66a8-4779-a6b4-f608f195c864 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.179781 Jul 28 09:23:10.008950 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 530/1035] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:09 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:11.029770 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3d94e31c-177f-4f69-888a-91c257deef69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:11.030389 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3d94e31c-177f-4f69-888a-91c257deef69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:11.036898 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d94e31c-177f-4f69-888a-91c257deef69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:11.037342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d94e31c-177f-4f69-888a-91c257deef69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:11.038132 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d94e31c-177f-4f69-888a-91c257deef69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:11.038563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-3d94e31c-177f-4f69-888a-91c257deef69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:11.184157 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3d94e31c-177f-4f69-888a-91c257deef69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:11.192035 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3d94e31c-177f-4f69-888a-91c257deef69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.166058 Jul 28 09:23:11.192913 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 506/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:11 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:11.462245 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-ad2ff8d1-5296-4cfd-b4dc-3801155bf4c5 req-74227ab5-3a16-4e42-96b3-7ed5f3219636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c938b286-4c8f-4695-b0fc-942f9c573cb9", "name": "network-vif-plugged", "status": "completed", "tag": "576868e7-d820-4531-a560-9a02eb21a924"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:23:11.471903 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ad2ff8d1-5296-4cfd-b4dc-3801155bf4c5 req-74227ab5-3a16-4e42-96b3-7ed5f3219636 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:11.472341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ad2ff8d1-5296-4cfd-b4dc-3801155bf4c5 req-74227ab5-3a16-4e42-96b3-7ed5f3219636 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:11.483224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-ad2ff8d1-5296-4cfd-b4dc-3801155bf4c5 req-74227ab5-3a16-4e42-96b3-7ed5f3219636 service nova] Creating event network-vif-plugged:576868e7-d820-4531-a560-9a02eb21a924 for instance c938b286-4c8f-4695-b0fc-942f9c573cb9 on hv-cinder-85124 Jul 28 09:23:11.488350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-ad2ff8d1-5296-4cfd-b4dc-3801155bf4c5 req-74227ab5-3a16-4e42-96b3-7ed5f3219636 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184362 Jul 28 09:23:11.488934 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 531/1037] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:23:12.212971 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b23bc112-9a8a-40fc-a207-0630c5c89167 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:12.213503 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b23bc112-9a8a-40fc-a207-0630c5c89167 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:12.220041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b23bc112-9a8a-40fc-a207-0630c5c89167 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:12.220426 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b23bc112-9a8a-40fc-a207-0630c5c89167 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:12.221202 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b23bc112-9a8a-40fc-a207-0630c5c89167 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:12.221640 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b23bc112-9a8a-40fc-a207-0630c5c89167 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:12.362246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b23bc112-9a8a-40fc-a207-0630c5c89167 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:12.371292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b23bc112-9a8a-40fc-a207-0630c5c89167 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1264 microversion: 2.1 time: 0.162578 Jul 28 09:23:12.372172 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 507/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:12 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:13.392984 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6461cea3-1981-47bc-9abc-df24a40cad4b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:13.394816 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6461cea3-1981-47bc-9abc-df24a40cad4b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:13.402403 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6461cea3-1981-47bc-9abc-df24a40cad4b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:13.403078 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6461cea3-1981-47bc-9abc-df24a40cad4b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:13.403856 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6461cea3-1981-47bc-9abc-df24a40cad4b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:13.404459 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6461cea3-1981-47bc-9abc-df24a40cad4b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:13.581682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6461cea3-1981-47bc-9abc-df24a40cad4b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:13.595746 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6461cea3-1981-47bc-9abc-df24a40cad4b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1450 microversion: 2.1 time: 0.206905 Jul 28 09:23:13.596461 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 532/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:13 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1450 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:13.615822 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-94ebf5dd-20e7-4cda-98f7-88084c20fc4c tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:13.616439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-94ebf5dd-20e7-4cda-98f7-88084c20fc4c tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:13.623394 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94ebf5dd-20e7-4cda-98f7-88084c20fc4c tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:13.623981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94ebf5dd-20e7-4cda-98f7-88084c20fc4c tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:13.624763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94ebf5dd-20e7-4cda-98f7-88084c20fc4c tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:13.625199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-94ebf5dd-20e7-4cda-98f7-88084c20fc4c tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:13.777010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-94ebf5dd-20e7-4cda-98f7-88084c20fc4c tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:13.784694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-94ebf5dd-20e7-4cda-98f7-88084c20fc4c tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1450 microversion: 2.1 time: 0.172669 Jul 28 09:23:13.785832 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 508/1040] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:13 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:16.317205 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-316b4eed-4c6f-426b-8b28-8cd6a33ede6c req-8050a06c-03bd-4541-bebd-1325fecfcabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c938b286-4c8f-4695-b0fc-942f9c573cb9", "tag": "576868e7-d820-4531-a560-9a02eb21a924"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:23:16.328821 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-316b4eed-4c6f-426b-8b28-8cd6a33ede6c req-8050a06c-03bd-4541-bebd-1325fecfcabd service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:16.329681 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-316b4eed-4c6f-426b-8b28-8cd6a33ede6c req-8050a06c-03bd-4541-bebd-1325fecfcabd service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:16.343261 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-316b4eed-4c6f-426b-8b28-8cd6a33ede6c req-8050a06c-03bd-4541-bebd-1325fecfcabd service nova] Creating event network-changed:576868e7-d820-4531-a560-9a02eb21a924 for instance c938b286-4c8f-4695-b0fc-942f9c573cb9 on hv-cinder-85124 Jul 28 09:23:16.348214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-316b4eed-4c6f-426b-8b28-8cd6a33ede6c req-8050a06c-03bd-4541-bebd-1325fecfcabd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185736 Jul 28 09:23:16.348927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 533/1041] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:23:30.658865 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-dbc7ef10-afe0-43ba-9463-aa6b4f47371b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:23:30.659434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-dbc7ef10-afe0-43ba-9463-aa6b4f47371b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:30.661878 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=15 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:30.662704 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=28 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:30.668431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dbc7ef10-afe0-43ba-9463-aa6b4f47371b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:30.668881 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dbc7ef10-afe0-43ba-9463-aa6b4f47371b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:30.669777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dbc7ef10-afe0-43ba-9463-aa6b4f47371b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:30.670302 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-dbc7ef10-afe0-43ba-9463-aa6b4f47371b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:30.697561 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-dbc7ef10-afe0-43ba-9463-aa6b4f47371b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lazy-loading 'flavor' on Instance uuid f2fc20a4-19f4-47bc-aa86-fe106b753112 {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:23:30.775570 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-dbc7ef10-afe0-43ba-9463-aa6b4f47371b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "POST /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112/action" status: 202 len: 0 microversion: 2.1 time: 0.120389 Jul 28 09:23:30.776165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 509/1042] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:23:30 2022] POST /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:23:30.785172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4b8a2be4-ea89-4a1d-b2f4-a32f74fa20c7 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:30.788061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4b8a2be4-ea89-4a1d-b2f4-a32f74fa20c7 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:30.796674 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=15 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:30.797606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=46 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:30.800187 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b8a2be4-ea89-4a1d-b2f4-a32f74fa20c7 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:30.800971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b8a2be4-ea89-4a1d-b2f4-a32f74fa20c7 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:30.802022 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b8a2be4-ea89-4a1d-b2f4-a32f74fa20c7 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:30.802653 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b8a2be4-ea89-4a1d-b2f4-a32f74fa20c7 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:30.985225 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4b8a2be4-ea89-4a1d-b2f4-a32f74fa20c7 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:30.998624 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4b8a2be4-ea89-4a1d-b2f4-a32f74fa20c7 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.217774 Jul 28 09:23:31.012507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 534/1043] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:30 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:23:32.020563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1f16367f-7ad7-4e57-8637-15b2221fa487 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:32.021159 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1f16367f-7ad7-4e57-8637-15b2221fa487 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:32.028593 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1f16367f-7ad7-4e57-8637-15b2221fa487 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:32.029050 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1f16367f-7ad7-4e57-8637-15b2221fa487 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:32.029828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1f16367f-7ad7-4e57-8637-15b2221fa487 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:32.030291 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1f16367f-7ad7-4e57-8637-15b2221fa487 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:32.167666 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1f16367f-7ad7-4e57-8637-15b2221fa487 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:32.176108 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1f16367f-7ad7-4e57-8637-15b2221fa487 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.159673 Jul 28 09:23:32.176685 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 510/1044] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:32 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:33.200394 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e7eb53d8-4eae-48cd-9e2c-01caf03df062 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:33.201414 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e7eb53d8-4eae-48cd-9e2c-01caf03df062 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:33.211012 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e7eb53d8-4eae-48cd-9e2c-01caf03df062 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:33.211469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e7eb53d8-4eae-48cd-9e2c-01caf03df062 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:33.212445 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e7eb53d8-4eae-48cd-9e2c-01caf03df062 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:33.212949 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e7eb53d8-4eae-48cd-9e2c-01caf03df062 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:33.382177 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e7eb53d8-4eae-48cd-9e2c-01caf03df062 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:33.391568 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e7eb53d8-4eae-48cd-9e2c-01caf03df062 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.196808 Jul 28 09:23:33.392137 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 535/1045] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:33 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:34.412788 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0716d41a-96a1-4544-80c2-946272a99c35 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:34.413406 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0716d41a-96a1-4544-80c2-946272a99c35 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:34.420697 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0716d41a-96a1-4544-80c2-946272a99c35 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:34.420981 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0716d41a-96a1-4544-80c2-946272a99c35 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:34.421823 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0716d41a-96a1-4544-80c2-946272a99c35 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:34.422199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0716d41a-96a1-4544-80c2-946272a99c35 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:34.557792 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0716d41a-96a1-4544-80c2-946272a99c35 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:34.566149 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0716d41a-96a1-4544-80c2-946272a99c35 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.157188 Jul 28 09:23:34.566760 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 511/1046] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:34 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:35.587745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0cc1d286-cb6e-4836-af0b-b07cd19aa9aa tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:35.588353 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0cc1d286-cb6e-4836-af0b-b07cd19aa9aa tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:35.594761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0cc1d286-cb6e-4836-af0b-b07cd19aa9aa tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:35.595210 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0cc1d286-cb6e-4836-af0b-b07cd19aa9aa tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:35.595982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0cc1d286-cb6e-4836-af0b-b07cd19aa9aa tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:35.596420 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0cc1d286-cb6e-4836-af0b-b07cd19aa9aa tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:35.734492 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0cc1d286-cb6e-4836-af0b-b07cd19aa9aa tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:35.746465 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0cc1d286-cb6e-4836-af0b-b07cd19aa9aa tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.162678 Jul 28 09:23:35.747172 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 536/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:35 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:23:36.768431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c9902e05-336e-4d78-b166-e41e9406fc6d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:36.769003 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c9902e05-336e-4d78-b166-e41e9406fc6d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:36.775987 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c9902e05-336e-4d78-b166-e41e9406fc6d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:36.776688 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c9902e05-336e-4d78-b166-e41e9406fc6d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:36.777595 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c9902e05-336e-4d78-b166-e41e9406fc6d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:36.778254 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c9902e05-336e-4d78-b166-e41e9406fc6d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:36.942701 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c9902e05-336e-4d78-b166-e41e9406fc6d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:36.951893 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c9902e05-336e-4d78-b166-e41e9406fc6d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.187807 Jul 28 09:23:36.952475 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 512/1048] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:36 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:23:37.976015 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e205dc90-0ea1-4075-b343-bfc48ed3c6ef tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:37.977530 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e205dc90-0ea1-4075-b343-bfc48ed3c6ef tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:37.985876 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e205dc90-0ea1-4075-b343-bfc48ed3c6ef tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:37.986329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e205dc90-0ea1-4075-b343-bfc48ed3c6ef tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:37.987099 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e205dc90-0ea1-4075-b343-bfc48ed3c6ef tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:37.987537 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e205dc90-0ea1-4075-b343-bfc48ed3c6ef tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:38.133200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e205dc90-0ea1-4075-b343-bfc48ed3c6ef tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:38.141728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e205dc90-0ea1-4075-b343-bfc48ed3c6ef tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.171206 Jul 28 09:23:38.142323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 537/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:37 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:39.164102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2d8a94b7-c2f5-4493-83f0-fa6267509b27 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:39.164956 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2d8a94b7-c2f5-4493-83f0-fa6267509b27 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:39.171603 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2d8a94b7-c2f5-4493-83f0-fa6267509b27 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:39.172047 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2d8a94b7-c2f5-4493-83f0-fa6267509b27 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:39.172812 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2d8a94b7-c2f5-4493-83f0-fa6267509b27 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:39.173241 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2d8a94b7-c2f5-4493-83f0-fa6267509b27 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:39.307225 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2d8a94b7-c2f5-4493-83f0-fa6267509b27 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:39.315827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2d8a94b7-c2f5-4493-83f0-fa6267509b27 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.155591 Jul 28 09:23:39.315827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 513/1050] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:39 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:40.336719 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-443e0e73-e370-4e05-b03e-49f5e30725e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:40.337441 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-443e0e73-e370-4e05-b03e-49f5e30725e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:40.344391 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-443e0e73-e370-4e05-b03e-49f5e30725e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:40.344935 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-443e0e73-e370-4e05-b03e-49f5e30725e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:40.346024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-443e0e73-e370-4e05-b03e-49f5e30725e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:40.346724 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-443e0e73-e370-4e05-b03e-49f5e30725e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:40.488112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-443e0e73-e370-4e05-b03e-49f5e30725e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:40.495491 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-443e0e73-e370-4e05-b03e-49f5e30725e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.162899 Jul 28 09:23:40.496054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 538/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:40 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:41.518146 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-53e19138-2881-4d0a-8578-dff64db5cf4b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:41.518866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-53e19138-2881-4d0a-8578-dff64db5cf4b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:41.525550 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-53e19138-2881-4d0a-8578-dff64db5cf4b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:41.525853 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-53e19138-2881-4d0a-8578-dff64db5cf4b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:41.526553 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-53e19138-2881-4d0a-8578-dff64db5cf4b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:41.526988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-53e19138-2881-4d0a-8578-dff64db5cf4b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:41.671922 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-53e19138-2881-4d0a-8578-dff64db5cf4b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:41.679401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-53e19138-2881-4d0a-8578-dff64db5cf4b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.165199 Jul 28 09:23:41.679969 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 514/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:41 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:42.701298 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-59156f6a-feb3-4e28-9601-e5dd0e4ebc4a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:42.702225 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-59156f6a-feb3-4e28-9601-e5dd0e4ebc4a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:42.712333 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59156f6a-feb3-4e28-9601-e5dd0e4ebc4a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:42.712781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59156f6a-feb3-4e28-9601-e5dd0e4ebc4a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:42.713561 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59156f6a-feb3-4e28-9601-e5dd0e4ebc4a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:42.714143 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59156f6a-feb3-4e28-9601-e5dd0e4ebc4a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:42.858181 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-59156f6a-feb3-4e28-9601-e5dd0e4ebc4a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:42.865751 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-59156f6a-feb3-4e28-9601-e5dd0e4ebc4a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.169160 Jul 28 09:23:42.866345 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 539/1053] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:42 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:43.887428 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0168d70b-fcee-436c-996c-04ae003e15df tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:43.888034 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0168d70b-fcee-436c-996c-04ae003e15df tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:43.894532 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0168d70b-fcee-436c-996c-04ae003e15df tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:43.894982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0168d70b-fcee-436c-996c-04ae003e15df tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:43.895743 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0168d70b-fcee-436c-996c-04ae003e15df tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:43.896184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0168d70b-fcee-436c-996c-04ae003e15df tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:44.031081 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-0168d70b-fcee-436c-996c-04ae003e15df tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:44.038512 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0168d70b-fcee-436c-996c-04ae003e15df tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.154953 Jul 28 09:23:44.039071 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 515/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:43 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:45.060987 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-96308764-1bbc-4bd4-808d-bd3f35b7f75d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:45.061865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-96308764-1bbc-4bd4-808d-bd3f35b7f75d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:45.069877 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96308764-1bbc-4bd4-808d-bd3f35b7f75d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:45.069877 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96308764-1bbc-4bd4-808d-bd3f35b7f75d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:45.069877 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96308764-1bbc-4bd4-808d-bd3f35b7f75d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:45.069877 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96308764-1bbc-4bd4-808d-bd3f35b7f75d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:45.198671 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-96308764-1bbc-4bd4-808d-bd3f35b7f75d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:45.206191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-96308764-1bbc-4bd4-808d-bd3f35b7f75d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.149722 Jul 28 09:23:45.206759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 540/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:45 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:46.227858 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-84c269fb-3a2c-49bf-8502-63de0bbe3aa5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:46.228456 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-84c269fb-3a2c-49bf-8502-63de0bbe3aa5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:46.234843 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-84c269fb-3a2c-49bf-8502-63de0bbe3aa5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:46.235285 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-84c269fb-3a2c-49bf-8502-63de0bbe3aa5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:46.236036 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-84c269fb-3a2c-49bf-8502-63de0bbe3aa5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:46.236462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-84c269fb-3a2c-49bf-8502-63de0bbe3aa5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:46.366187 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-84c269fb-3a2c-49bf-8502-63de0bbe3aa5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:46.374179 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-84c269fb-3a2c-49bf-8502-63de0bbe3aa5 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.150138 Jul 28 09:23:46.374742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 516/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:46 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:47.394881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a604d931-92e5-4894-9c15-f17cf1152f96 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:47.395501 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a604d931-92e5-4894-9c15-f17cf1152f96 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:47.402489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a604d931-92e5-4894-9c15-f17cf1152f96 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:47.402938 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a604d931-92e5-4894-9c15-f17cf1152f96 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:47.403712 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a604d931-92e5-4894-9c15-f17cf1152f96 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:47.404150 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a604d931-92e5-4894-9c15-f17cf1152f96 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:47.546037 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a604d931-92e5-4894-9c15-f17cf1152f96 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:47.553685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a604d931-92e5-4894-9c15-f17cf1152f96 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.162670 Jul 28 09:23:47.554308 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 541/1057] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:47 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:48.575108 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-efa28cb1-f8d1-4eac-9af4-e540d2fb05b0 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:48.575712 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-efa28cb1-f8d1-4eac-9af4-e540d2fb05b0 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:48.582372 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-efa28cb1-f8d1-4eac-9af4-e540d2fb05b0 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:48.582825 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-efa28cb1-f8d1-4eac-9af4-e540d2fb05b0 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:48.583604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-efa28cb1-f8d1-4eac-9af4-e540d2fb05b0 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:48.584040 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-efa28cb1-f8d1-4eac-9af4-e540d2fb05b0 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:48.718278 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-efa28cb1-f8d1-4eac-9af4-e540d2fb05b0 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:48.726059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-efa28cb1-f8d1-4eac-9af4-e540d2fb05b0 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.154695 Jul 28 09:23:48.726635 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 517/1058] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:48 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:49.748812 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-733065b2-cb69-4589-991c-66902cf8953b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:49.749667 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-733065b2-cb69-4589-991c-66902cf8953b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:49.756186 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-733065b2-cb69-4589-991c-66902cf8953b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:49.756628 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-733065b2-cb69-4589-991c-66902cf8953b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:49.757378 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-733065b2-cb69-4589-991c-66902cf8953b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:49.757810 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-733065b2-cb69-4589-991c-66902cf8953b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:49.900718 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-733065b2-cb69-4589-991c-66902cf8953b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:49.909515 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-733065b2-cb69-4589-991c-66902cf8953b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1570 microversion: 2.1 time: 0.165148 Jul 28 09:23:49.910127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 542/1059] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:49 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:49.931215 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0ed1d0c4-3b2e-4d50-83f2-d3a02c313d6a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:23:49.931818 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0ed1d0c4-3b2e-4d50-83f2-d3a02c313d6a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:49.938547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0ed1d0c4-3b2e-4d50-83f2-d3a02c313d6a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:49.938995 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0ed1d0c4-3b2e-4d50-83f2-d3a02c313d6a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:49.940180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0ed1d0c4-3b2e-4d50-83f2-d3a02c313d6a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:49.940180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0ed1d0c4-3b2e-4d50-83f2-d3a02c313d6a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:50.079868 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0ed1d0c4-3b2e-4d50-83f2-d3a02c313d6a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117863) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 09:23:50.149139 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0ed1d0c4-3b2e-4d50-83f2-d3a02c313d6a tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "POST /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112/action" status: 202 len: 0 microversion: 2.1 time: 0.222302 Jul 28 09:23:50.153138 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 518/1060] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:23:49 2022] POST /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:23:50.162104 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6f763ee2-8d68-4075-9400-01d16722fa92 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:50.165900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6f763ee2-8d68-4075-9400-01d16722fa92 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:50.169902 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f763ee2-8d68-4075-9400-01d16722fa92 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:50.170439 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f763ee2-8d68-4075-9400-01d16722fa92 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:50.171277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f763ee2-8d68-4075-9400-01d16722fa92 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:50.171741 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f763ee2-8d68-4075-9400-01d16722fa92 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:50.317500 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6f763ee2-8d68-4075-9400-01d16722fa92 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:50.327700 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6f763ee2-8d68-4075-9400-01d16722fa92 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1578 microversion: 2.1 time: 0.173146 Jul 28 09:23:50.328375 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 543/1061] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:50 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:51.350533 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ca516083-9f6d-4944-97d1-d1bffe996b9c tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:51.351155 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ca516083-9f6d-4944-97d1-d1bffe996b9c tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:51.358520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca516083-9f6d-4944-97d1-d1bffe996b9c tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:51.359078 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca516083-9f6d-4944-97d1-d1bffe996b9c tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:51.359917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca516083-9f6d-4944-97d1-d1bffe996b9c tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:51.360561 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca516083-9f6d-4944-97d1-d1bffe996b9c tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:51.495639 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ca516083-9f6d-4944-97d1-d1bffe996b9c tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:51.503194 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ca516083-9f6d-4944-97d1-d1bffe996b9c tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1578 microversion: 2.1 time: 0.157386 Jul 28 09:23:51.503757 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 519/1062] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:51 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:52.526883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-723ea4ec-c6c3-469a-9a78-05a65e9ab33b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:52.527738 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-723ea4ec-c6c3-469a-9a78-05a65e9ab33b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:52.535522 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-723ea4ec-c6c3-469a-9a78-05a65e9ab33b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:52.536089 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-723ea4ec-c6c3-469a-9a78-05a65e9ab33b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:52.536860 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-723ea4ec-c6c3-469a-9a78-05a65e9ab33b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:52.537291 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-723ea4ec-c6c3-469a-9a78-05a65e9ab33b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:52.620554 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-e752796f-4f34-4954-a9d6-2ad5d3ecc9f1 req-3600e2ee-13bf-4fd7-8727-3f5d05017413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc20a4-19f4-47bc-aa86-fe106b753112", "name": "network-vif-unplugged", "status": "completed", "tag": "a0c11b49-c1f8-46bc-898f-8e43eaaa04d4"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:23:52.633384 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-e752796f-4f34-4954-a9d6-2ad5d3ecc9f1 req-3600e2ee-13bf-4fd7-8727-3f5d05017413 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:52.634292 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-e752796f-4f34-4954-a9d6-2ad5d3ecc9f1 req-3600e2ee-13bf-4fd7-8727-3f5d05017413 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:52.650256 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-e752796f-4f34-4954-a9d6-2ad5d3ecc9f1 req-3600e2ee-13bf-4fd7-8727-3f5d05017413 service nova] Creating event network-vif-unplugged:a0c11b49-c1f8-46bc-898f-8e43eaaa04d4 for instance f2fc20a4-19f4-47bc-aa86-fe106b753112 on hv-cinder-85124 Jul 28 09:23:52.656002 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-e752796f-4f34-4954-a9d6-2ad5d3ecc9f1 req-3600e2ee-13bf-4fd7-8727-3f5d05017413 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039236 Jul 28 09:23:52.657304 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 520/1063] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:23:52.685641 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-723ea4ec-c6c3-469a-9a78-05a65e9ab33b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:52.693432 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-723ea4ec-c6c3-469a-9a78-05a65e9ab33b tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1578 microversion: 2.1 time: 0.172758 Jul 28 09:23:52.694205 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 544/1064] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:52 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:53.718982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8e2240f8-1ea2-421e-a19d-183a2ce06224 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:53.719669 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8e2240f8-1ea2-421e-a19d-183a2ce06224 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:53.725919 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8e2240f8-1ea2-421e-a19d-183a2ce06224 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:53.726469 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8e2240f8-1ea2-421e-a19d-183a2ce06224 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:53.727728 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8e2240f8-1ea2-421e-a19d-183a2ce06224 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:53.728281 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8e2240f8-1ea2-421e-a19d-183a2ce06224 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:53.865211 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8e2240f8-1ea2-421e-a19d-183a2ce06224 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:53.873104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8e2240f8-1ea2-421e-a19d-183a2ce06224 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1578 microversion: 2.1 time: 0.160191 Jul 28 09:23:53.873675 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 521/1065] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:53 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:54.900145 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f342a7d4-98c3-4325-af6e-3169f8738347 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:54.900690 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f342a7d4-98c3-4325-af6e-3169f8738347 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:54.907386 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f342a7d4-98c3-4325-af6e-3169f8738347 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:54.907837 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f342a7d4-98c3-4325-af6e-3169f8738347 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:54.908611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f342a7d4-98c3-4325-af6e-3169f8738347 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:54.909052 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f342a7d4-98c3-4325-af6e-3169f8738347 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:55.039937 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-f342a7d4-98c3-4325-af6e-3169f8738347 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:55.048051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f342a7d4-98c3-4325-af6e-3169f8738347 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1520 microversion: 2.1 time: 0.151862 Jul 28 09:23:55.048608 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 545/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:54 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:56.070596 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-17f8c6f3-9016-4263-a32e-fcb3c7993655 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:56.071168 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-17f8c6f3-9016-4263-a32e-fcb3c7993655 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:56.078940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-17f8c6f3-9016-4263-a32e-fcb3c7993655 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:56.079397 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-17f8c6f3-9016-4263-a32e-fcb3c7993655 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:56.080411 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-17f8c6f3-9016-4263-a32e-fcb3c7993655 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:56.080855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-17f8c6f3-9016-4263-a32e-fcb3c7993655 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:56.276178 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-17f8c6f3-9016-4263-a32e-fcb3c7993655 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:56.283800 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-17f8c6f3-9016-4263-a32e-fcb3c7993655 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.217310 Jul 28 09:23:56.284376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 522/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:56 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:57.306080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d362bb54-d17c-46ac-9235-a4363f9ec970 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:57.306715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d362bb54-d17c-46ac-9235-a4363f9ec970 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:57.313805 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d362bb54-d17c-46ac-9235-a4363f9ec970 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:57.314317 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d362bb54-d17c-46ac-9235-a4363f9ec970 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:57.315161 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d362bb54-d17c-46ac-9235-a4363f9ec970 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:57.315599 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d362bb54-d17c-46ac-9235-a4363f9ec970 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:57.450557 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d362bb54-d17c-46ac-9235-a4363f9ec970 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:57.459330 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d362bb54-d17c-46ac-9235-a4363f9ec970 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.157048 Jul 28 09:23:57.459885 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 546/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:57 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:58.487620 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c816c8b7-f2fa-4505-ab29-72bc6db77839 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:58.488274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c816c8b7-f2fa-4505-ab29-72bc6db77839 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:58.495185 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c816c8b7-f2fa-4505-ab29-72bc6db77839 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:58.495580 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c816c8b7-f2fa-4505-ab29-72bc6db77839 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:58.496341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c816c8b7-f2fa-4505-ab29-72bc6db77839 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:58.496798 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c816c8b7-f2fa-4505-ab29-72bc6db77839 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:58.501540 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:58.648258 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c816c8b7-f2fa-4505-ab29-72bc6db77839 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:58.655842 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c816c8b7-f2fa-4505-ab29-72bc6db77839 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.172680 Jul 28 09:23:58.656432 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 523/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:58 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:23:59.676570 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-978837fa-abde-493e-9194-cf4fc42042f3 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:23:59.677127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-978837fa-abde-493e-9194-cf4fc42042f3 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:23:59.683478 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-978837fa-abde-493e-9194-cf4fc42042f3 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:59.683921 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-978837fa-abde-493e-9194-cf4fc42042f3 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:59.684673 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-978837fa-abde-493e-9194-cf4fc42042f3 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:23:59.685103 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-978837fa-abde-493e-9194-cf4fc42042f3 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:23:59.813351 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-978837fa-abde-493e-9194-cf4fc42042f3 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:23:59.821096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-978837fa-abde-493e-9194-cf4fc42042f3 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.148451 Jul 28 09:23:59.821668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 547/1070] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:23:59 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:00.842911 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-12db5f72-0141-4807-9aba-4d0dde7f8354 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:00.843526 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-12db5f72-0141-4807-9aba-4d0dde7f8354 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:00.846407 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:00.851749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12db5f72-0141-4807-9aba-4d0dde7f8354 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:00.852200 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12db5f72-0141-4807-9aba-4d0dde7f8354 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:00.852969 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12db5f72-0141-4807-9aba-4d0dde7f8354 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:00.853408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12db5f72-0141-4807-9aba-4d0dde7f8354 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:01.021784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-12db5f72-0141-4807-9aba-4d0dde7f8354 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:01.029530 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-12db5f72-0141-4807-9aba-4d0dde7f8354 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.190391 Jul 28 09:24:01.030152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 524/1071] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:00 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:02.051103 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-29c741d0-9ed5-415e-8497-20d76ad9bb46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:02.051717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-29c741d0-9ed5-415e-8497-20d76ad9bb46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:02.054170 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=29 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:02.060023 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-29c741d0-9ed5-415e-8497-20d76ad9bb46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:02.060481 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-29c741d0-9ed5-415e-8497-20d76ad9bb46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:02.061255 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-29c741d0-9ed5-415e-8497-20d76ad9bb46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:02.061692 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-29c741d0-9ed5-415e-8497-20d76ad9bb46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:02.064355 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=85 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:02.196126 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-29c741d0-9ed5-415e-8497-20d76ad9bb46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:02.204269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-29c741d0-9ed5-415e-8497-20d76ad9bb46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.158185 Jul 28 09:24:02.204865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 548/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:02 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:03.224966 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2a7a0fb1-cc4c-4638-baf1-c85771025948 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:03.225515 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2a7a0fb1-cc4c-4638-baf1-c85771025948 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:03.231827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7a0fb1-cc4c-4638-baf1-c85771025948 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:03.232278 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7a0fb1-cc4c-4638-baf1-c85771025948 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:03.233034 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7a0fb1-cc4c-4638-baf1-c85771025948 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:03.233471 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2a7a0fb1-cc4c-4638-baf1-c85771025948 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:03.370924 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-2a7a0fb1-cc4c-4638-baf1-c85771025948 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:03.378503 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2a7a0fb1-cc4c-4638-baf1-c85771025948 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.157436 Jul 28 09:24:03.379070 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 525/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:03 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:04.398555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e3dfdd76-2fd6-46f0-8863-e336e45b5c48 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:04.399162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e3dfdd76-2fd6-46f0-8863-e336e45b5c48 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:04.405584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd76-2fd6-46f0-8863-e336e45b5c48 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:04.406063 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd76-2fd6-46f0-8863-e336e45b5c48 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:04.406814 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd76-2fd6-46f0-8863-e336e45b5c48 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:04.407242 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e3dfdd76-2fd6-46f0-8863-e336e45b5c48 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:04.537203 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e3dfdd76-2fd6-46f0-8863-e336e45b5c48 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:04.544822 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e3dfdd76-2fd6-46f0-8863-e336e45b5c48 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.150170 Jul 28 09:24:04.545386 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 549/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:04 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:05.566680 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-384ed7e1-4ca9-4612-bda7-a2bc256c3c76 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:05.567286 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-384ed7e1-4ca9-4612-bda7-a2bc256c3c76 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:05.573694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-384ed7e1-4ca9-4612-bda7-a2bc256c3c76 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:05.574193 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-384ed7e1-4ca9-4612-bda7-a2bc256c3c76 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:05.574955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-384ed7e1-4ca9-4612-bda7-a2bc256c3c76 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:05.575392 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-384ed7e1-4ca9-4612-bda7-a2bc256c3c76 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:05.706727 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-384ed7e1-4ca9-4612-bda7-a2bc256c3c76 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:05.714606 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-384ed7e1-4ca9-4612-bda7-a2bc256c3c76 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.152353 Jul 28 09:24:05.715171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 526/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:05 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:06.736612 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0ef8e206-8214-433f-8830-8c5486d388ed tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:06.737224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0ef8e206-8214-433f-8830-8c5486d388ed tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:06.743874 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ef8e206-8214-433f-8830-8c5486d388ed tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:06.744324 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ef8e206-8214-433f-8830-8c5486d388ed tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:06.745084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ef8e206-8214-433f-8830-8c5486d388ed tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:06.745536 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ef8e206-8214-433f-8830-8c5486d388ed tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:06.876341 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-0ef8e206-8214-433f-8830-8c5486d388ed tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:06.883837 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0ef8e206-8214-433f-8830-8c5486d388ed tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.151601 Jul 28 09:24:06.884406 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 550/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:06 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:07.904584 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-225586cc-bf04-4d29-9a39-78ffeb6bfb1d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:07.905189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-225586cc-bf04-4d29-9a39-78ffeb6bfb1d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:07.911993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-225586cc-bf04-4d29-9a39-78ffeb6bfb1d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:07.912439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-225586cc-bf04-4d29-9a39-78ffeb6bfb1d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:07.913204 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-225586cc-bf04-4d29-9a39-78ffeb6bfb1d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:07.913637 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-225586cc-bf04-4d29-9a39-78ffeb6bfb1d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:08.045199 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-225586cc-bf04-4d29-9a39-78ffeb6bfb1d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:08.052616 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-225586cc-bf04-4d29-9a39-78ffeb6bfb1d tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.151946 Jul 28 09:24:08.053180 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 527/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:07 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:08.483715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-037a6ad0-92ec-4952-ad77-b2ccf67dfc54 req-35488126-f666-4387-9cb1-398db064781f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc20a4-19f4-47bc-aa86-fe106b753112", "name": "network-vif-plugged", "status": "completed", "tag": "a0c11b49-c1f8-46bc-898f-8e43eaaa04d4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:08.494051 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-037a6ad0-92ec-4952-ad77-b2ccf67dfc54 req-35488126-f666-4387-9cb1-398db064781f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:08.494687 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-037a6ad0-92ec-4952-ad77-b2ccf67dfc54 req-35488126-f666-4387-9cb1-398db064781f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:08.506124 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-037a6ad0-92ec-4952-ad77-b2ccf67dfc54 req-35488126-f666-4387-9cb1-398db064781f service nova] Creating event network-vif-plugged:a0c11b49-c1f8-46bc-898f-8e43eaaa04d4 for instance f2fc20a4-19f4-47bc-aa86-fe106b753112 on hv-cinder-85124 Jul 28 09:24:08.511081 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-037a6ad0-92ec-4952-ad77-b2ccf67dfc54 req-35488126-f666-4387-9cb1-398db064781f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031270 Jul 28 09:24:08.511675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 551/1078] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:24:09.073427 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-360d8fac-8b41-4303-8290-a4d0d83a478f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:09.074081 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-360d8fac-8b41-4303-8290-a4d0d83a478f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:09.080982 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-360d8fac-8b41-4303-8290-a4d0d83a478f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:09.081434 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-360d8fac-8b41-4303-8290-a4d0d83a478f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:09.082262 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-360d8fac-8b41-4303-8290-a4d0d83a478f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:09.082746 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-360d8fac-8b41-4303-8290-a4d0d83a478f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:09.214159 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-360d8fac-8b41-4303-8290-a4d0d83a478f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:09.222242 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-360d8fac-8b41-4303-8290-a4d0d83a478f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.152658 Jul 28 09:24:09.222855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 528/1079] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:09 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:10.244426 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-05d042c2-b0cc-433b-a424-b6bab4bf16e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:10.245029 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-05d042c2-b0cc-433b-a424-b6bab4bf16e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:10.251769 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05d042c2-b0cc-433b-a424-b6bab4bf16e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:10.252215 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05d042c2-b0cc-433b-a424-b6bab4bf16e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:10.252974 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05d042c2-b0cc-433b-a424-b6bab4bf16e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:10.253404 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05d042c2-b0cc-433b-a424-b6bab4bf16e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:10.383300 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-05d042c2-b0cc-433b-a424-b6bab4bf16e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:10.390878 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-05d042c2-b0cc-433b-a424-b6bab4bf16e1 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1576 microversion: 2.1 time: 0.151281 Jul 28 09:24:10.391508 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 552/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:10 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:11.411858 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b07221e4-0dbc-41c8-937d-c4da0734b107 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:11.412462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b07221e4-0dbc-41c8-937d-c4da0734b107 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:11.419829 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b07221e4-0dbc-41c8-937d-c4da0734b107 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:11.420284 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b07221e4-0dbc-41c8-937d-c4da0734b107 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:11.421044 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b07221e4-0dbc-41c8-937d-c4da0734b107 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:11.421483 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b07221e4-0dbc-41c8-937d-c4da0734b107 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:11.551555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b07221e4-0dbc-41c8-937d-c4da0734b107 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:11.558690 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b07221e4-0dbc-41c8-937d-c4da0734b107 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1563 microversion: 2.1 time: 0.150680 Jul 28 09:24:11.559261 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 529/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:11 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:35.645680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1858163861", "imageRef": "ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd", "flavorRef": "452"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:35.653144 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=9 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:35.653800 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=25 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:35.697606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] validate_networks() for None {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:24:35.966891 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:24:35.967323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:24:35.967829 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:24:35.968242 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:24:35.968778 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:24:35.979134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:35.979588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:35.980398 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:35.980852 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:35.997156 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Getting quotas for project 7ea63f58bc674db7b5ce6274a3785897. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:24:36.001104 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Getting quotas for user 8941b7a73e7948e0a243c3356e151809 and project 7ea63f58bc674db7b5ce6274a3785897. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:24:36.012226 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:24:36.014677 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee87734b-5cbe-4d3d-9ed2-45f63a63e5fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:24:36.057142 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9b7ea957-415d-4dd8-b298-fd333f0275aa tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415184 Jul 28 09:24:36.058154 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 553/1082] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:24:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:24:36.068458 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bb867078-7a93-45b8-909c-93b2c12c97ba tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:36.069062 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bb867078-7a93-45b8-909c-93b2c12c97ba tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:36.071725 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=11 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:36.072373 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=40 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:36.123324 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bb867078-7a93-45b8-909c-93b2c12c97ba tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:36.130038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bb867078-7a93-45b8-909c-93b2c12c97ba tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1215 microversion: 2.1 time: 0.065489 Jul 28 09:24:36.134342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 530/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:36 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:37.151210 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-253b8c20-8170-4902-a1a4-3493a7da6152 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:37.151992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-253b8c20-8170-4902-a1a4-3493a7da6152 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:37.159017 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-253b8c20-8170-4902-a1a4-3493a7da6152 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:37.159452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-253b8c20-8170-4902-a1a4-3493a7da6152 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:37.160429 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-253b8c20-8170-4902-a1a4-3493a7da6152 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:37.160859 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-253b8c20-8170-4902-a1a4-3493a7da6152 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:37.239426 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-253b8c20-8170-4902-a1a4-3493a7da6152 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:37.247696 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-253b8c20-8170-4902-a1a4-3493a7da6152 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1285 microversion: 2.1 time: 0.101439 Jul 28 09:24:37.248257 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 554/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:37 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:38.269294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e4e1a116-9509-4f30-bfe5-221ef777d130 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:38.270170 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e4e1a116-9509-4f30-bfe5-221ef777d130 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:38.277020 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4e1a116-9509-4f30-bfe5-221ef777d130 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:38.277574 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4e1a116-9509-4f30-bfe5-221ef777d130 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:38.278394 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4e1a116-9509-4f30-bfe5-221ef777d130 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:38.278827 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4e1a116-9509-4f30-bfe5-221ef777d130 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:38.487266 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e4e1a116-9509-4f30-bfe5-221ef777d130 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:38.496113 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e4e1a116-9509-4f30-bfe5-221ef777d130 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1315 microversion: 2.1 time: 0.231328 Jul 28 09:24:38.497009 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 531/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:38 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:38.769955 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-6e843c3d-2217-44f3-ae40-87817eb37dae req-2e138343-c0c5-4261-a1aa-9d92e50aeb3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6c30aa-84af-423d-bc95-abfeb032ce8a", "tag": "b3d5c9de-6e33-42fc-a798-89e674bcef04"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:38.780219 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-6e843c3d-2217-44f3-ae40-87817eb37dae req-2e138343-c0c5-4261-a1aa-9d92e50aeb3c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:38.780841 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-6e843c3d-2217-44f3-ae40-87817eb37dae req-2e138343-c0c5-4261-a1aa-9d92e50aeb3c service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:38.797611 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-6e843c3d-2217-44f3-ae40-87817eb37dae req-2e138343-c0c5-4261-a1aa-9d92e50aeb3c service nova] Creating event network-changed:b3d5c9de-6e33-42fc-a798-89e674bcef04 for instance df6c30aa-84af-423d-bc95-abfeb032ce8a on hv-cinder-85124 Jul 28 09:24:38.803656 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-6e843c3d-2217-44f3-ae40-87817eb37dae req-2e138343-c0c5-4261-a1aa-9d92e50aeb3c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037250 Jul 28 09:24:38.804657 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 555/1086] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:24:39.523409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-9e7d94c3-63a6-4a14-bf8d-d61ef9b660f2 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:39.523967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-9e7d94c3-63a6-4a14-bf8d-d61ef9b660f2 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:39.531012 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9e7d94c3-63a6-4a14-bf8d-d61ef9b660f2 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:39.531457 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9e7d94c3-63a6-4a14-bf8d-d61ef9b660f2 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:39.532216 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9e7d94c3-63a6-4a14-bf8d-d61ef9b660f2 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:39.532648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-9e7d94c3-63a6-4a14-bf8d-d61ef9b660f2 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:39.665182 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-9e7d94c3-63a6-4a14-bf8d-d61ef9b660f2 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:39.673492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-9e7d94c3-63a6-4a14-bf8d-d61ef9b660f2 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1315 microversion: 2.1 time: 0.154030 Jul 28 09:24:39.674100 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 532/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:39 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:40.695879 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cfaf4977-18bd-4af2-92d8-96891e788894 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:40.696815 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cfaf4977-18bd-4af2-92d8-96891e788894 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:40.704623 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cfaf4977-18bd-4af2-92d8-96891e788894 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:40.705168 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cfaf4977-18bd-4af2-92d8-96891e788894 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:40.706163 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cfaf4977-18bd-4af2-92d8-96891e788894 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:40.706659 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cfaf4977-18bd-4af2-92d8-96891e788894 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:40.848349 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-cfaf4977-18bd-4af2-92d8-96891e788894 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:40.856315 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cfaf4977-18bd-4af2-92d8-96891e788894 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1315 microversion: 2.1 time: 0.165523 Jul 28 09:24:40.856884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 556/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:40 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:41.877043 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1a6e5785-ccf4-4672-a8e9-023a9f4bcaf0 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:41.877646 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1a6e5785-ccf4-4672-a8e9-023a9f4bcaf0 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:41.884409 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1a6e5785-ccf4-4672-a8e9-023a9f4bcaf0 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:41.884857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1a6e5785-ccf4-4672-a8e9-023a9f4bcaf0 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:41.885621 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1a6e5785-ccf4-4672-a8e9-023a9f4bcaf0 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:41.886083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1a6e5785-ccf4-4672-a8e9-023a9f4bcaf0 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:42.346823 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1a6e5785-ccf4-4672-a8e9-023a9f4bcaf0 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:42.354922 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1a6e5785-ccf4-4672-a8e9-023a9f4bcaf0 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1315 microversion: 2.1 time: 0.481904 Jul 28 09:24:42.355492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 533/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:41 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:43.376125 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3daa8c32-27ed-45bc-ba8c-56755cc6d561 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:43.376819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3daa8c32-27ed-45bc-ba8c-56755cc6d561 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:43.383544 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3daa8c32-27ed-45bc-ba8c-56755cc6d561 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:43.384012 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3daa8c32-27ed-45bc-ba8c-56755cc6d561 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:43.384817 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3daa8c32-27ed-45bc-ba8c-56755cc6d561 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:43.385224 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3daa8c32-27ed-45bc-ba8c-56755cc6d561 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:43.532310 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3daa8c32-27ed-45bc-ba8c-56755cc6d561 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:43.540798 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3daa8c32-27ed-45bc-ba8c-56755cc6d561 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1315 microversion: 2.1 time: 0.168664 Jul 28 09:24:43.541423 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 557/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:43 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:44.566334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bce25ac8-0798-4f80-8655-a2902b7a5c74 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:44.566937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bce25ac8-0798-4f80-8655-a2902b7a5c74 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:44.574405 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bce25ac8-0798-4f80-8655-a2902b7a5c74 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:44.574847 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bce25ac8-0798-4f80-8655-a2902b7a5c74 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:44.575609 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bce25ac8-0798-4f80-8655-a2902b7a5c74 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:44.576038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bce25ac8-0798-4f80-8655-a2902b7a5c74 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:44.713398 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-bce25ac8-0798-4f80-8655-a2902b7a5c74 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:44.722864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bce25ac8-0798-4f80-8655-a2902b7a5c74 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1315 microversion: 2.1 time: 0.160376 Jul 28 09:24:44.729899 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 534/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:44 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:44.745805 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-31c3fe2a-8ccb-4d6b-ad4c-c574fd4fc371 req-f03d5d45-67b1-4c39-a837-9735209427a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6c30aa-84af-423d-bc95-abfeb032ce8a", "name": "network-vif-plugged", "status": "completed", "tag": "b3d5c9de-6e33-42fc-a798-89e674bcef04"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:44.756213 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-31c3fe2a-8ccb-4d6b-ad4c-c574fd4fc371 req-f03d5d45-67b1-4c39-a837-9735209427a0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:44.756835 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-31c3fe2a-8ccb-4d6b-ad4c-c574fd4fc371 req-f03d5d45-67b1-4c39-a837-9735209427a0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:44.768982 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-31c3fe2a-8ccb-4d6b-ad4c-c574fd4fc371 req-f03d5d45-67b1-4c39-a837-9735209427a0 service nova] Creating event network-vif-plugged:b3d5c9de-6e33-42fc-a798-89e674bcef04 for instance df6c30aa-84af-423d-bc95-abfeb032ce8a on hv-cinder-85124 Jul 28 09:24:44.774082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-31c3fe2a-8ccb-4d6b-ad4c-c574fd4fc371 req-f03d5d45-67b1-4c39-a837-9735209427a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036189 Jul 28 09:24:44.774834 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 558/1092] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:24:45.746914 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b8e959f1-e104-4c96-bc23-1e5dce83ea8a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:45.747523 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b8e959f1-e104-4c96-bc23-1e5dce83ea8a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:45.754274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b8e959f1-e104-4c96-bc23-1e5dce83ea8a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:45.754730 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b8e959f1-e104-4c96-bc23-1e5dce83ea8a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:45.755504 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b8e959f1-e104-4c96-bc23-1e5dce83ea8a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:45.755941 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b8e959f1-e104-4c96-bc23-1e5dce83ea8a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:45.898117 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b8e959f1-e104-4c96-bc23-1e5dce83ea8a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:45.906161 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b8e959f1-e104-4c96-bc23-1e5dce83ea8a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1315 microversion: 2.1 time: 0.163093 Jul 28 09:24:45.906731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 535/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:45 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:46.924606 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:46.925652 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:46.929809 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4e1c2b8a-6ce9-4105-b018-c9ffb56203eb tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:46.930548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4e1c2b8a-6ce9-4105-b018-c9ffb56203eb tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:46.937665 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4e1c2b8a-6ce9-4105-b018-c9ffb56203eb tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:46.938138 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4e1c2b8a-6ce9-4105-b018-c9ffb56203eb tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:46.938907 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4e1c2b8a-6ce9-4105-b018-c9ffb56203eb tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:46.939367 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4e1c2b8a-6ce9-4105-b018-c9ffb56203eb tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:47.072811 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-4e1c2b8a-6ce9-4105-b018-c9ffb56203eb tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:47.080289 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4e1c2b8a-6ce9-4105-b018-c9ffb56203eb tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1465 microversion: 2.1 time: 0.157212 Jul 28 09:24:47.080869 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 559/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:46 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:47.132576 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c68d36e1-8698-4a77-97e1-61d502673be5 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:47.133281 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c68d36e1-8698-4a77-97e1-61d502673be5 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:47.135142 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:47.142484 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c68d36e1-8698-4a77-97e1-61d502673be5 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:47.142940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c68d36e1-8698-4a77-97e1-61d502673be5 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:47.143742 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c68d36e1-8698-4a77-97e1-61d502673be5 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:47.144187 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c68d36e1-8698-4a77-97e1-61d502673be5 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:47.174736 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c68d36e1-8698-4a77-97e1-61d502673be5 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:24:47.253883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c68d36e1-8698-4a77-97e1-61d502673be5 tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "DELETE /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 204 len: 0 microversion: 2.1 time: 0.129282 Jul 28 09:24:47.254585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 536/1095] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:24:47 2022] DELETE /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:24:47.263881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-350443e5-fc7b-4160-b2f6-bd6654d78adf tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:47.264584 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-350443e5-fc7b-4160-b2f6-bd6654d78adf tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:47.271489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-350443e5-fc7b-4160-b2f6-bd6654d78adf tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:47.271933 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-350443e5-fc7b-4160-b2f6-bd6654d78adf tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:47.272794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-350443e5-fc7b-4160-b2f6-bd6654d78adf tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:47.273226 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-350443e5-fc7b-4160-b2f6-bd6654d78adf tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:47.415221 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-350443e5-fc7b-4160-b2f6-bd6654d78adf tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:47.423673 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-350443e5-fc7b-4160-b2f6-bd6654d78adf tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1471 microversion: 2.1 time: 0.164742 Jul 28 09:24:47.424264 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 560/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:47 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:48.447252 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-436ede5f-355a-4e7a-b0b9-380eecb7384a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:48.447945 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-436ede5f-355a-4e7a-b0b9-380eecb7384a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:48.455031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-436ede5f-355a-4e7a-b0b9-380eecb7384a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:48.455481 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-436ede5f-355a-4e7a-b0b9-380eecb7384a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:48.456254 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-436ede5f-355a-4e7a-b0b9-380eecb7384a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:48.456691 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-436ede5f-355a-4e7a-b0b9-380eecb7384a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:48.593506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-436ede5f-355a-4e7a-b0b9-380eecb7384a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:48.601341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-436ede5f-355a-4e7a-b0b9-380eecb7384a tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1471 microversion: 2.1 time: 0.158275 Jul 28 09:24:48.601943 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 537/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:48 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:49.443486 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-459d6feb-d093-4b59-af48-08d215f63091 req-e400a146-f709-4340-badf-84bdf525614f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6c30aa-84af-423d-bc95-abfeb032ce8a", "name": "network-vif-deleted", "tag": "b3d5c9de-6e33-42fc-a798-89e674bcef04"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:49.454896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-459d6feb-d093-4b59-af48-08d215f63091 req-e400a146-f709-4340-badf-84bdf525614f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:49.455338 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-459d6feb-d093-4b59-af48-08d215f63091 req-e400a146-f709-4340-badf-84bdf525614f service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:49.468339 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-459d6feb-d093-4b59-af48-08d215f63091 req-e400a146-f709-4340-badf-84bdf525614f service nova] Creating event network-vif-deleted:b3d5c9de-6e33-42fc-a798-89e674bcef04 for instance df6c30aa-84af-423d-bc95-abfeb032ce8a on hv-cinder-85124 Jul 28 09:24:49.478881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-459d6feb-d093-4b59-af48-08d215f63091 req-e400a146-f709-4340-badf-84bdf525614f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039141 Jul 28 09:24:49.480102 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 561/1098] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:24:49.627351 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:49.628333 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:49.634961 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:49.635410 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:49.636697 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:49.637138 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:49.669521 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:49.669959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:49.670431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.objects.instance [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lazy-loading 'fault' on Instance uuid df6c30aa-84af-423d-bc95-abfeb032ce8a {{(pid=117863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:24:49.715336 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8941b7a73e7948e0a243c3356e151809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea63f58bc674db7b5ce6274a3785897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:49.722966 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6a899cd4-db9c-405e-a243-964992360cfd tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 200 len: 1305 microversion: 2.1 time: 0.103223 Jul 28 09:24:49.723547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 538/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:49 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:50.746215 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:50.746870 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] [instance: df6c30aa-84af-423d-bc95-abfeb032ce8a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:24:50.753040 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:50.753493 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:50.754322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:24:50.754764 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:24:50.768803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] HTTP exception thrown: Instance df6c30aa-84af-423d-bc95-abfeb032ce8a could not be found. Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Request method failure captured: Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a HTTP/1.1 Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lXSfwjkkUunp_4kGPRdMbsi73XQCNbms53ioNIvsZvGAGyMEno1Xy4G2_ofd3dAw7THREG81WqBrKIFlqr4a0xdxLy_m14Ps4toT5DWRagUlJF5D1tClJUk9Pk9AmOuZ-o4LANRzthEnMaplLfoAyv-VWzmKjc6jIt07ATBXcRG2ss Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 7ea63f58bc674db7b5ce6274a3785897 Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesNegativeTest-2100158033 Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:24:50.770469 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ea63f58bc674db7b5ce6274a3785897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea63f58bc674db7b5ce6274a3785897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ea63f58bc674db7b5ce6274a3785897", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea63f58bc674db7b5ce6274a3785897"}]}] Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-VolumesNegativeTest-2100158033 Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 7ea63f58bc674db7b5ce6274a3785897 Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesNegativeTest-2100158033 Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-VolumesNegativeTest-2100158033-project Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: 8941b7a73e7948e0a243c3356e151809 Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-VolumesNegativeTest-2100158033-project Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance df6c30aa-84af-423d-bc95-abfeb032ce8a could not be found. Jul 28 09:24:50.772327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'df6c30aa-84af-423d-bc95-abfeb032ce8a'} Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6c30aa-84af-423d-bc95-abfeb032ce8a could not be found. Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:24:50.773389 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6c30aa-84af-423d-bc95-abfeb032ce8a could not be found. Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6c30aa-84af-423d-bc95-abfeb032ce8a could not be found. Jul 28 09:24:50.775279 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:24:50.777217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] Returning 404 to user: Instance df6c30aa-84af-423d-bc95-abfeb032ce8a could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:24:50.777217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d36e218a-b314-4789-b431-e2366c9708ec tempest-VolumesNegativeTest-2100158033 tempest-VolumesNegativeTest-2100158033-project] 10.222.0.48 "GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a" status: 404 len: 111 microversion: 2.1 time: 0.031579 Jul 28 09:24:50.777217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 562/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:24:50 2022] GET /compute/v2.1/servers/df6c30aa-84af-423d-bc95-abfeb032ce8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:25:15.585580 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e62350dd-e2e6-45d1-a60a-6d0bae0a7a9f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Action: 'create', calling method: .version_select at 0x7fd6c4132e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1524824059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbGt3/oZiqSJbqTx4l4B8+HT6iHn592DSQj8exkk2rWh5P92Yw9PG88bothHQhM9ACu3mPOOQX4c165Lfj/s6daaiWNvkOWlURp/yB6GXHrSyor/SmwZ2aWmfZnX7OVeQ=="}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:15.592130 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:15.592942 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:15.606632 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-e62350dd-e2e6-45d1-a60a-6d0bae0a7a9f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Getting quotas for project 33b2e26d27c84e738eede31dc3c9ee3a. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:25:15.611127 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-e62350dd-e2e6-45d1-a60a-6d0bae0a7a9f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Getting quotas for user cafc77c67a844f248b0879d39d5511dd and project 33b2e26d27c84e738eede31dc3c9ee3a. Resources: {'key_pairs'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:25:15.624258 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e62350dd-e2e6-45d1-a60a-6d0bae0a7a9f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [c1f6de19-6580-4417-901a-bbc81f26df9c] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 09:25:16.631831 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO oslo.messaging._drivers.impl_rabbit [None req-e62350dd-e2e6-45d1-a60a-6d0bae0a7a9f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [c1f6de19-6580-4417-901a-bbc81f26df9c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44902. Jul 28 09:25:16.651612 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e62350dd-e2e6-45d1-a60a-6d0bae0a7a9f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.069578 Jul 28 09:25:16.652352 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 539/1101] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 09:25:15 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:16.710594 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1907553327", "imageRef": "468140a5-27f5-4c35-b7b7-70a55f4c1d6d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1524824059", "networks": [{"uuid": "ede8e961-7a06-4e8d-a4f9-2de355af10b7"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:16.720155 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:16.720799 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=40 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:16.775433 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] validate_networks() for [('ede8e961-7a06-4e8d-a4f9-2de355af10b7', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:25:17.176053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:25:17.176470 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:25:17.176940 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:25:17.177390 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:25:17.177796 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:25:17.187418 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:17.187864 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:17.188662 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:17.189094 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:17.206504 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Getting quotas for project 33b2e26d27c84e738eede31dc3c9ee3a. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:25:17.210673 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Getting quotas for user cafc77c67a844f248b0879d39d5511dd and project 33b2e26d27c84e738eede31dc3c9ee3a. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:25:17.222900 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:25:17.225080 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='468140a5-27f5-4c35-b7b7-70a55f4c1d6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:25:17.275788 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-195e3e52-8d99-4d09-93ce-5273f14fd6fb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570201 Jul 28 09:25:17.276738 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 563/1102] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:25:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 09:25:17.288779 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-3c4751b3-7ff5-474d-ba55-1ef206deceb5 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:17.289385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-3c4751b3-7ff5-474d-ba55-1ef206deceb5 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:17.358001 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-3c4751b3-7ff5-474d-ba55-1ef206deceb5 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:17.366075 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-3c4751b3-7ff5-474d-ba55-1ef206deceb5 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1259 microversion: 2.1 time: 0.082398 Jul 28 09:25:17.366629 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 540/1103] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:17 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1259 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:18.387626 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d062788-7216-4caa-8062-b38d211518b3 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:18.388525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8d062788-7216-4caa-8062-b38d211518b3 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:18.395338 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d062788-7216-4caa-8062-b38d211518b3 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:18.395790 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d062788-7216-4caa-8062-b38d211518b3 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:18.396575 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d062788-7216-4caa-8062-b38d211518b3 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:18.397020 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d062788-7216-4caa-8062-b38d211518b3 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:18.478582 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d062788-7216-4caa-8062-b38d211518b3 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:18.506685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8d062788-7216-4caa-8062-b38d211518b3 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1311 microversion: 2.1 time: 0.123866 Jul 28 09:25:18.507751 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 564/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:18 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:19.536134 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-55c243c2-e930-49e1-9b58-78c48fd64eb6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:19.537396 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-55c243c2-e930-49e1-9b58-78c48fd64eb6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:19.550961 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55c243c2-e930-49e1-9b58-78c48fd64eb6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:19.551976 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55c243c2-e930-49e1-9b58-78c48fd64eb6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:19.553374 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55c243c2-e930-49e1-9b58-78c48fd64eb6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:19.554171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-55c243c2-e930-49e1-9b58-78c48fd64eb6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:20.017976 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-55c243c2-e930-49e1-9b58-78c48fd64eb6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:20.035327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-55c243c2-e930-49e1-9b58-78c48fd64eb6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.505946 Jul 28 09:25:20.036168 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 541/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:19 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:21.073732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bda05ef6-25aa-482b-a949-e4892989aeeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:21.074653 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bda05ef6-25aa-482b-a949-e4892989aeeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:21.084540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bda05ef6-25aa-482b-a949-e4892989aeeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:21.085168 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bda05ef6-25aa-482b-a949-e4892989aeeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:21.086314 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bda05ef6-25aa-482b-a949-e4892989aeeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:21.087514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bda05ef6-25aa-482b-a949-e4892989aeeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:21.278427 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-bda05ef6-25aa-482b-a949-e4892989aeeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:21.286995 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bda05ef6-25aa-482b-a949-e4892989aeeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.219939 Jul 28 09:25:21.287578 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 565/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:21 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:22.308309 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e4ad2133-b16d-453a-98c8-3ba740f4fae7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:22.309188 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e4ad2133-b16d-453a-98c8-3ba740f4fae7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:22.315755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4ad2133-b16d-453a-98c8-3ba740f4fae7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:22.316298 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4ad2133-b16d-453a-98c8-3ba740f4fae7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:22.317121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4ad2133-b16d-453a-98c8-3ba740f4fae7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:22.317661 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e4ad2133-b16d-453a-98c8-3ba740f4fae7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:22.480428 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e4ad2133-b16d-453a-98c8-3ba740f4fae7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:22.491462 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e4ad2133-b16d-453a-98c8-3ba740f4fae7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.186626 Jul 28 09:25:22.492437 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 542/1107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:22 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:23.517252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ff2d8afc-c1b5-436c-a901-22b09e26f1cb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:23.518678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ff2d8afc-c1b5-436c-a901-22b09e26f1cb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:23.526876 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ff2d8afc-c1b5-436c-a901-22b09e26f1cb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:23.527745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ff2d8afc-c1b5-436c-a901-22b09e26f1cb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:23.534908 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ff2d8afc-c1b5-436c-a901-22b09e26f1cb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:23.536009 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ff2d8afc-c1b5-436c-a901-22b09e26f1cb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:23.701868 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-ff2d8afc-c1b5-436c-a901-22b09e26f1cb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:23.715110 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ff2d8afc-c1b5-436c-a901-22b09e26f1cb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.202389 Jul 28 09:25:23.726524 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 566/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:23 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:24.747822 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-713d3545-328b-493c-9246-5707550c6ef7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:24.748936 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-713d3545-328b-493c-9246-5707550c6ef7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:24.758954 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-713d3545-328b-493c-9246-5707550c6ef7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:24.759967 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-713d3545-328b-493c-9246-5707550c6ef7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:24.763218 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-713d3545-328b-493c-9246-5707550c6ef7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:24.765117 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-713d3545-328b-493c-9246-5707550c6ef7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:24.938727 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-713d3545-328b-493c-9246-5707550c6ef7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:24.946769 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-713d3545-328b-493c-9246-5707550c6ef7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.203124 Jul 28 09:25:24.948173 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 543/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:24 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:25.972071 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-372948bc-7df5-4444-b71b-606fd88e0fc2 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:25.972923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-372948bc-7df5-4444-b71b-606fd88e0fc2 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:25.982944 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-372948bc-7df5-4444-b71b-606fd88e0fc2 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:25.983646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-372948bc-7df5-4444-b71b-606fd88e0fc2 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:25.984927 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-372948bc-7df5-4444-b71b-606fd88e0fc2 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:25.986165 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-372948bc-7df5-4444-b71b-606fd88e0fc2 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:26.189640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-372948bc-7df5-4444-b71b-606fd88e0fc2 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:26.198646 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-372948bc-7df5-4444-b71b-606fd88e0fc2 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.231675 Jul 28 09:25:26.199227 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 567/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:25 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:27.222884 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-07e48eff-bc55-45e6-b14b-41fa20770690 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:27.223542 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-07e48eff-bc55-45e6-b14b-41fa20770690 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:27.231668 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07e48eff-bc55-45e6-b14b-41fa20770690 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:27.231668 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07e48eff-bc55-45e6-b14b-41fa20770690 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:27.231968 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07e48eff-bc55-45e6-b14b-41fa20770690 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:27.232275 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-07e48eff-bc55-45e6-b14b-41fa20770690 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:27.363013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=6 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:27.367438 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-07e48eff-bc55-45e6-b14b-41fa20770690 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:27.378115 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-07e48eff-bc55-45e6-b14b-41fa20770690 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.159226 Jul 28 09:25:27.378680 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 544/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:27 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:28.404084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-59e97e82-dcfd-4672-a3ab-2c3d133b70b1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:28.404873 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-59e97e82-dcfd-4672-a3ab-2c3d133b70b1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:28.407022 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:28.407696 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:28.413556 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59e97e82-dcfd-4672-a3ab-2c3d133b70b1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:28.414005 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59e97e82-dcfd-4672-a3ab-2c3d133b70b1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:28.414778 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59e97e82-dcfd-4672-a3ab-2c3d133b70b1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:28.415211 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-59e97e82-dcfd-4672-a3ab-2c3d133b70b1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:28.563532 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-59e97e82-dcfd-4672-a3ab-2c3d133b70b1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:28.571233 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-59e97e82-dcfd-4672-a3ab-2c3d133b70b1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.174485 Jul 28 09:25:28.571819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 568/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:28 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:29.595148 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d97a860e-3c96-443e-8983-310cab933375 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:29.596005 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d97a860e-3c96-443e-8983-310cab933375 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:29.607839 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d97a860e-3c96-443e-8983-310cab933375 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:29.611361 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d97a860e-3c96-443e-8983-310cab933375 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:29.612545 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d97a860e-3c96-443e-8983-310cab933375 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:29.614611 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d97a860e-3c96-443e-8983-310cab933375 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:29.840908 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d97a860e-3c96-443e-8983-310cab933375 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:29.850694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d97a860e-3c96-443e-8983-310cab933375 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.259486 Jul 28 09:25:29.860341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 545/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:29 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:29.991566 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-b74810bc-0142-4035-9665-d3002332a778 req-59e0d50e-aff6-496b-8963-e715f759c5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546f23a4-a39c-4249-8865-0e4fdb2059e8", "tag": "0df8d7f9-7a57-41a6-a60d-c88e0c7cac22"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:30.008139 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b74810bc-0142-4035-9665-d3002332a778 req-59e0d50e-aff6-496b-8963-e715f759c5d0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:30.008603 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b74810bc-0142-4035-9665-d3002332a778 req-59e0d50e-aff6-496b-8963-e715f759c5d0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:30.024112 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-b74810bc-0142-4035-9665-d3002332a778 req-59e0d50e-aff6-496b-8963-e715f759c5d0 service nova] Creating event network-changed:0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 for instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 on hv-cinder-85124 Jul 28 09:25:30.030266 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-b74810bc-0142-4035-9665-d3002332a778 req-59e0d50e-aff6-496b-8963-e715f759c5d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045975 Jul 28 09:25:30.031229 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 569/1114] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:25:30.871560 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b33dbe3b-cce0-4f83-9449-7b45ff088fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:30.872167 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b33dbe3b-cce0-4f83-9449-7b45ff088fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:30.884642 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b33dbe3b-cce0-4f83-9449-7b45ff088fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:30.885102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b33dbe3b-cce0-4f83-9449-7b45ff088fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:30.885907 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b33dbe3b-cce0-4f83-9449-7b45ff088fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:30.886362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b33dbe3b-cce0-4f83-9449-7b45ff088fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:31.039767 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b33dbe3b-cce0-4f83-9449-7b45ff088fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:31.047544 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b33dbe3b-cce0-4f83-9449-7b45ff088fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.179749 Jul 28 09:25:31.048121 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 546/1115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:30 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:32.069633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dfb4a4c4-a550-4d37-a039-32500d058fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:32.070337 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dfb4a4c4-a550-4d37-a039-32500d058fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:32.076912 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c4-a550-4d37-a039-32500d058fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:32.077358 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c4-a550-4d37-a039-32500d058fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:32.078179 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c4-a550-4d37-a039-32500d058fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:32.078619 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c4-a550-4d37-a039-32500d058fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:32.235521 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dfb4a4c4-a550-4d37-a039-32500d058fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:32.236013 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dfb4a4c4-a550-4d37-a039-32500d058fa8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.170681 Jul 28 09:25:32.236309 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 570/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:32 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:33.269998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8fa8603b-1a2e-4c38-95cf-71a6d2fe5211 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:33.270857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8fa8603b-1a2e-4c38-95cf-71a6d2fe5211 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:33.279011 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8fa8603b-1a2e-4c38-95cf-71a6d2fe5211 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:33.279548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8fa8603b-1a2e-4c38-95cf-71a6d2fe5211 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:33.280401 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8fa8603b-1a2e-4c38-95cf-71a6d2fe5211 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:33.280904 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8fa8603b-1a2e-4c38-95cf-71a6d2fe5211 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:33.429928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8fa8603b-1a2e-4c38-95cf-71a6d2fe5211 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:33.438602 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8fa8603b-1a2e-4c38-95cf-71a6d2fe5211 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.173735 Jul 28 09:25:33.439181 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 547/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:33 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:34.471763 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d7423e91-25cd-46a8-b737-7be5583bdb4a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:34.472476 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d7423e91-25cd-46a8-b737-7be5583bdb4a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:34.479138 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7423e91-25cd-46a8-b737-7be5583bdb4a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:34.479589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7423e91-25cd-46a8-b737-7be5583bdb4a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:34.480365 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7423e91-25cd-46a8-b737-7be5583bdb4a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:34.480883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7423e91-25cd-46a8-b737-7be5583bdb4a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:34.689134 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d7423e91-25cd-46a8-b737-7be5583bdb4a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:34.696902 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d7423e91-25cd-46a8-b737-7be5583bdb4a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.229182 Jul 28 09:25:34.697493 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 571/1118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:34 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:35.719098 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-51b522e4-e4d5-4510-9ad0-4ee5c1ce941e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:35.719716 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-51b522e4-e4d5-4510-9ad0-4ee5c1ce941e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:35.726385 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-51b522e4-e4d5-4510-9ad0-4ee5c1ce941e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:35.726835 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-51b522e4-e4d5-4510-9ad0-4ee5c1ce941e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:35.727602 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-51b522e4-e4d5-4510-9ad0-4ee5c1ce941e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:35.728040 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-51b522e4-e4d5-4510-9ad0-4ee5c1ce941e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:35.880882 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-51b522e4-e4d5-4510-9ad0-4ee5c1ce941e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:35.888610 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-51b522e4-e4d5-4510-9ad0-4ee5c1ce941e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.173357 Jul 28 09:25:35.889192 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 548/1119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:35 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:36.910643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-33bd4714-ec7b-469e-bd46-548084773ae1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:36.911303 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-33bd4714-ec7b-469e-bd46-548084773ae1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:36.922113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33bd4714-ec7b-469e-bd46-548084773ae1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:36.922689 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33bd4714-ec7b-469e-bd46-548084773ae1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:36.923810 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33bd4714-ec7b-469e-bd46-548084773ae1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:36.924367 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33bd4714-ec7b-469e-bd46-548084773ae1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:37.060645 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-7a7c9ee4-d118-4c42-9dcc-1195b2a1182a req-f472f59a-f692-4c57-b5a5-66cd58e853ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546f23a4-a39c-4249-8865-0e4fdb2059e8", "name": "network-vif-plugged", "status": "completed", "tag": "0df8d7f9-7a57-41a6-a60d-c88e0c7cac22"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:37.081092 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-7a7c9ee4-d118-4c42-9dcc-1195b2a1182a req-f472f59a-f692-4c57-b5a5-66cd58e853ad service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:37.084870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-7a7c9ee4-d118-4c42-9dcc-1195b2a1182a req-f472f59a-f692-4c57-b5a5-66cd58e853ad service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:37.107384 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-7a7c9ee4-d118-4c42-9dcc-1195b2a1182a req-f472f59a-f692-4c57-b5a5-66cd58e853ad service nova] Creating event network-vif-plugged:0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 for instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 on hv-cinder-85124 Jul 28 09:25:37.116763 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-7a7c9ee4-d118-4c42-9dcc-1195b2a1182a req-f472f59a-f692-4c57-b5a5-66cd58e853ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061004 Jul 28 09:25:37.117563 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 549/1120] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:25:37.121430 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-33bd4714-ec7b-469e-bd46-548084773ae1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:37.130728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-33bd4714-ec7b-469e-bd46-548084773ae1 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.224013 Jul 28 09:25:37.131362 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 572/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:36 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:38.160464 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f7862a1d-fce7-42e5-b191-7da81a70f656 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:38.161156 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f7862a1d-fce7-42e5-b191-7da81a70f656 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:38.168994 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f7862a1d-fce7-42e5-b191-7da81a70f656 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:38.169444 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f7862a1d-fce7-42e5-b191-7da81a70f656 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:38.170252 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f7862a1d-fce7-42e5-b191-7da81a70f656 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:38.170687 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f7862a1d-fce7-42e5-b191-7da81a70f656 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:38.319697 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f7862a1d-fce7-42e5-b191-7da81a70f656 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:38.329144 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f7862a1d-fce7-42e5-b191-7da81a70f656 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1359 microversion: 2.1 time: 0.173750 Jul 28 09:25:38.329718 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 550/1122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:38 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:39.352850 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d71552e0-a8dd-4dc8-9a11-f7b6fe768257 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:39.353529 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d71552e0-a8dd-4dc8-9a11-f7b6fe768257 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:39.367065 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d71552e0-a8dd-4dc8-9a11-f7b6fe768257 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:39.367832 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d71552e0-a8dd-4dc8-9a11-f7b6fe768257 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:39.368935 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d71552e0-a8dd-4dc8-9a11-f7b6fe768257 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:39.369627 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d71552e0-a8dd-4dc8-9a11-f7b6fe768257 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:39.531981 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d71552e0-a8dd-4dc8-9a11-f7b6fe768257 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:39.548593 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d71552e0-a8dd-4dc8-9a11-f7b6fe768257 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1548 microversion: 2.1 time: 0.200488 Jul 28 09:25:39.549177 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 573/1123] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:39 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:39.569543 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c5c9c511-faa7-4016-a81a-5e566cf3a74e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:39.570336 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c5c9c511-faa7-4016-a81a-5e566cf3a74e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:39.578131 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c5c9c511-faa7-4016-a81a-5e566cf3a74e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:39.578575 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c5c9c511-faa7-4016-a81a-5e566cf3a74e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:39.579345 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c5c9c511-faa7-4016-a81a-5e566cf3a74e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:39.579771 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c5c9c511-faa7-4016-a81a-5e566cf3a74e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:39.742870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c5c9c511-faa7-4016-a81a-5e566cf3a74e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:39.750729 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c5c9c511-faa7-4016-a81a-5e566cf3a74e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1548 microversion: 2.1 time: 0.185054 Jul 28 09:25:39.751311 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 551/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:39 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:39.772109 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:39.777417 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:39.778218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Searching by: {'deleted': False, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a'} {{(pid=117864) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 09:25:39.785440 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:39.785923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:39.786732 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:39.787170 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:39.896118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.multi_cell_list [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 09:25:40.008980 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-10d0b288-24d7-48c8-bfc7-6dc8b850460a tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.240909 Jul 28 09:25:40.009567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 574/1125] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 09:25:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:40.022348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8eaaf3b8-1b34-48f0-a5bd-edd7d543a984 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:40.022959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8eaaf3b8-1b34-48f0-a5bd-edd7d543a984 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:40.029648 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8eaaf3b8-1b34-48f0-a5bd-edd7d543a984 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:40.030274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8eaaf3b8-1b34-48f0-a5bd-edd7d543a984 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:40.031046 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8eaaf3b8-1b34-48f0-a5bd-edd7d543a984 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:40.031483 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8eaaf3b8-1b34-48f0-a5bd-edd7d543a984 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:40.172894 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8eaaf3b8-1b34-48f0-a5bd-edd7d543a984 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:40.181320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8eaaf3b8-1b34-48f0-a5bd-edd7d543a984 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1548 microversion: 2.1 time: 0.163013 Jul 28 09:25:40.181947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 552/1126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:40 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:41.797897 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d1672076-4625-45f5-ac4d-100c39e9cfd8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73e79990-8f41-43d2-80d6-3f5e0976ea93"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:41.800548 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d1672076-4625-45f5-ac4d-100c39e9cfd8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:41.807887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d1672076-4625-45f5-ac4d-100c39e9cfd8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:41.808329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d1672076-4625-45f5-ac4d-100c39e9cfd8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:41.809092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d1672076-4625-45f5-ac4d-100c39e9cfd8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:41.809520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d1672076-4625-45f5-ac4d-100c39e9cfd8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:42.104399 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d1672076-4625-45f5-ac4d-100c39e9cfd8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "POST /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309762 Jul 28 09:25:42.107964 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 575/1127] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 09:25:41 2022] POST /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:48.465303 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-518a0268-ca14-40c3-bc17-4b0dfb59ac79 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:48.465955 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-518a0268-ca14-40c3-bc17-4b0dfb59ac79 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:48.468604 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:48.473798 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-90bf4078-2f4b-4b94-b05f-263ead8f1053 req-902509c8-ba6b-4282-b71e-7c5db8ab45ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fc20a4-19f4-47bc-aa86-fe106b753112", "tag": "a0c11b49-c1f8-46bc-898f-8e43eaaa04d4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:48.476282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-518a0268-ca14-40c3-bc17-4b0dfb59ac79 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:48.477028 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-518a0268-ca14-40c3-bc17-4b0dfb59ac79 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:48.477920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-518a0268-ca14-40c3-bc17-4b0dfb59ac79 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:48.478433 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-518a0268-ca14-40c3-bc17-4b0dfb59ac79 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:48.480992 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:48.485294 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=69 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:48.490804 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-90bf4078-2f4b-4b94-b05f-263ead8f1053 req-902509c8-ba6b-4282-b71e-7c5db8ab45ba service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:48.491444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-90bf4078-2f4b-4b94-b05f-263ead8f1053 req-902509c8-ba6b-4282-b71e-7c5db8ab45ba service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:48.498334 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:48.509619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-518a0268-ca14-40c3-bc17-4b0dfb59ac79 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:25:48.513385 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-90bf4078-2f4b-4b94-b05f-263ead8f1053 req-902509c8-ba6b-4282-b71e-7c5db8ab45ba service nova] Creating event network-changed:a0c11b49-c1f8-46bc-898f-8e43eaaa04d4 for instance f2fc20a4-19f4-47bc-aa86-fe106b753112 on hv-cinder-85124 Jul 28 09:25:48.531429 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-90bf4078-2f4b-4b94-b05f-263ead8f1053 req-902509c8-ba6b-4282-b71e-7c5db8ab45ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064526 Jul 28 09:25:48.531766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 576/1128] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:48.653810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-518a0268-ca14-40c3-bc17-4b0dfb59ac79 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 204 len: 0 microversion: 2.1 time: 0.191706 Jul 28 09:25:48.653810 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 553/1129] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:25:48 2022] DELETE /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:25:48.663377 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3bcdd8ed-30a2-44d8-978f-f0f580bc9468 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:48.664131 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3bcdd8ed-30a2-44d8-978f-f0f580bc9468 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:48.672803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3bcdd8ed-30a2-44d8-978f-f0f580bc9468 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:48.673249 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3bcdd8ed-30a2-44d8-978f-f0f580bc9468 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:48.674073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3bcdd8ed-30a2-44d8-978f-f0f580bc9468 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:48.674508 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3bcdd8ed-30a2-44d8-978f-f0f580bc9468 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:48.876707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3bcdd8ed-30a2-44d8-978f-f0f580bc9468 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:48.885688 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3bcdd8ed-30a2-44d8-978f-f0f580bc9468 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.226683 Jul 28 09:25:48.886327 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 577/1130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:48 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:49.909538 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-82cff6e1-5bb2-412c-8e45-5f6e70681295 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:49.910187 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-82cff6e1-5bb2-412c-8e45-5f6e70681295 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:49.917274 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-82cff6e1-5bb2-412c-8e45-5f6e70681295 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:49.917723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-82cff6e1-5bb2-412c-8e45-5f6e70681295 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:49.918564 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-82cff6e1-5bb2-412c-8e45-5f6e70681295 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:49.919004 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-82cff6e1-5bb2-412c-8e45-5f6e70681295 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:50.289535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-82cff6e1-5bb2-412c-8e45-5f6e70681295 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:50.298088 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-82cff6e1-5bb2-412c-8e45-5f6e70681295 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1569 microversion: 2.1 time: 0.392985 Jul 28 09:25:50.298660 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 554/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:49 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1569 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:50.936768 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fc873cc8-e6a6-4a0d-b642-61046393caeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:50.937431 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fc873cc8-e6a6-4a0d-b642-61046393caeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:50.941322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:50.946060 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc873cc8-e6a6-4a0d-b642-61046393caeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:50.946653 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc873cc8-e6a6-4a0d-b642-61046393caeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:50.948122 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc873cc8-e6a6-4a0d-b642-61046393caeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:50.948628 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fc873cc8-e6a6-4a0d-b642-61046393caeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:51.268903 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-fc873cc8-e6a6-4a0d-b642-61046393caeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:51.278101 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fc873cc8-e6a6-4a0d-b642-61046393caeb tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1594 microversion: 2.1 time: 0.345039 Jul 28 09:25:51.278760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 578/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:50 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1594 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:51.320390 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a1c7898d-580d-4fa1-be40-c63cb1077d46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:51.321105 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a1c7898d-580d-4fa1-be40-c63cb1077d46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:51.329129 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a1c7898d-580d-4fa1-be40-c63cb1077d46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:51.329422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a1c7898d-580d-4fa1-be40-c63cb1077d46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:51.330223 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a1c7898d-580d-4fa1-be40-c63cb1077d46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:51.330653 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a1c7898d-580d-4fa1-be40-c63cb1077d46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:51.584311 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-8b16fe6e-013e-4518-bcad-a105c87d0828 req-64c3161f-1880-48af-8ff6-02a373c261f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fc20a4-19f4-47bc-aa86-fe106b753112", "name": "network-vif-deleted", "tag": "a0c11b49-c1f8-46bc-898f-8e43eaaa04d4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:51.584894 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a1c7898d-580d-4fa1-be40-c63cb1077d46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc41a77cdfb426caa5c86ecab2298e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd239676ec42e0a9f145e924fc249a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:51.595526 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a1c7898d-580d-4fa1-be40-c63cb1077d46 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 200 len: 1450 microversion: 2.1 time: 0.279663 Jul 28 09:25:51.596247 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 555/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:51 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 1450 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:51.599041 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8b16fe6e-013e-4518-bcad-a105c87d0828 req-64c3161f-1880-48af-8ff6-02a373c261f4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:51.599493 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8b16fe6e-013e-4518-bcad-a105c87d0828 req-64c3161f-1880-48af-8ff6-02a373c261f4 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:51.612491 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-8b16fe6e-013e-4518-bcad-a105c87d0828 req-64c3161f-1880-48af-8ff6-02a373c261f4 service nova] Creating event network-vif-deleted:a0c11b49-c1f8-46bc-898f-8e43eaaa04d4 for instance f2fc20a4-19f4-47bc-aa86-fe106b753112 on hv-cinder-85124 Jul 28 09:25:51.617977 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-8b16fe6e-013e-4518-bcad-a105c87d0828 req-64c3161f-1880-48af-8ff6-02a373c261f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038168 Jul 28 09:25:51.618830 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 579/1134] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:52.624538 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:52.625921 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] [instance: f2fc20a4-19f4-47bc-aa86-fe106b753112] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:52.635361 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:52.635974 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:52.636928 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:52.637373 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:52.660997 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] HTTP exception thrown: Instance f2fc20a4-19f4-47bc-aa86-fe106b753112 could not be found. Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Request method failure captured: Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 HTTP/1.1 Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lTGUNRtD4jpw9JWBlnCyCS2jYwBiifPRb6eYEickFNix3xy382y9w_R6aErMfcNj34DJQ-kyYjLcg4Y9Hwlft2lD6bAKvEUGmb6sH-Gl9zxSS1-clg2b3LvhijqNf0VI__PZ-wrelaq7mKgbErtA2l6AUWt2LLM-lOkUWOA0fapnW0 Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: 53fd239676ec42e0a9f145e924fc249a Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-TestShelveInstance-736678905 Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:25:52.663069 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/53fd239676ec42e0a9f145e924fc249a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/53fd239676ec42e0a9f145e924fc249a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_53fd239676ec42e0a9f145e924fc249a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/53fd239676ec42e0a9f145e924fc249a"}]}] Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-TestShelveInstance-736678905 Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: 53fd239676ec42e0a9f145e924fc249a Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-TestShelveInstance-736678905 Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-TestShelveInstance-736678905-project Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: bcc41a77cdfb426caa5c86ecab2298e8 Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-TestShelveInstance-736678905-project Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance f2fc20a4-19f4-47bc-aa86-fe106b753112 could not be found. Jul 28 09:25:52.664852 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'f2fc20a4-19f4-47bc-aa86-fe106b753112'} Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fc20a4-19f4-47bc-aa86-fe106b753112 could not be found. Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:25:52.666376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fc20a4-19f4-47bc-aa86-fe106b753112 could not be found. Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fc20a4-19f4-47bc-aa86-fe106b753112 could not be found. Jul 28 09:25:52.668937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:25:52.672049 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Returning 404 to user: Instance f2fc20a4-19f4-47bc-aa86-fe106b753112 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:25:52.673147 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7a6c3e1e-2133-4481-b1d6-704ceb1d6e90 tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112" status: 404 len: 111 microversion: 2.1 time: 0.056139 Jul 28 09:25:52.673781 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 556/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:52 2022] GET /compute/v2.1/servers/f2fc20a4-19f4-47bc-aa86-fe106b753112 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:25:52.861382 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bb2e1e55-c9d7-41df-bbb0-5f9c2b03769f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] Calling method '.version_select at 0x7fd6c41040d0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:52.902839 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bb2e1e55-c9d7-41df-bbb0-5f9c2b03769f tempest-TestShelveInstance-736678905 tempest-TestShelveInstance-736678905-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1279686165" status: 202 len: 0 microversion: 2.1 time: 0.048970 Jul 28 09:25:52.903706 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 580/1136] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Jul 28 09:25:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1279686165 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:53.602499 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-d3f14e1a-05b9-4e07-bd74-71a578f99bc6 req-f6688eab-fa45-46ba-ba91-8575b56f32a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546f23a4-a39c-4249-8865-0e4fdb2059e8", "tag": "0df8d7f9-7a57-41a6-a60d-c88e0c7cac22"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:53.615598 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-d3f14e1a-05b9-4e07-bd74-71a578f99bc6 req-f6688eab-fa45-46ba-ba91-8575b56f32a9 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:53.616640 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-d3f14e1a-05b9-4e07-bd74-71a578f99bc6 req-f6688eab-fa45-46ba-ba91-8575b56f32a9 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:53.633609 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-d3f14e1a-05b9-4e07-bd74-71a578f99bc6 req-f6688eab-fa45-46ba-ba91-8575b56f32a9 service nova] Creating event network-changed:0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 for instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 on hv-cinder-85124 Jul 28 09:25:53.641440 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-d3f14e1a-05b9-4e07-bd74-71a578f99bc6 req-f6688eab-fa45-46ba-ba91-8575b56f32a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212069 Jul 28 09:25:53.643557 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 557/1137] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:54.904530 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-841aa061-81eb-4ae5-aea7-a85d35664ea8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1911187866"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:54.905313 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-841aa061-81eb-4ae5-aea7-a85d35664ea8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:54.912827 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-841aa061-81eb-4ae5-aea7-a85d35664ea8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:54.913269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-841aa061-81eb-4ae5-aea7-a85d35664ea8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:54.914321 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-841aa061-81eb-4ae5-aea7-a85d35664ea8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:54.914766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-841aa061-81eb-4ae5-aea7-a85d35664ea8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:55.427122 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.network.security_group_api [None req-841aa061-81eb-4ae5-aea7-a85d35664ea8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Adding security group 6a14a700-f970-4c42-bef4-cb741bd28c99 to port 0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 Jul 28 09:25:56.069642 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-841aa061-81eb-4ae5-aea7-a85d35664ea8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "POST /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/action" status: 202 len: 0 microversion: 2.1 time: 1.169656 Jul 28 09:25:56.071390 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 581/1138] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:25:54 2022] POST /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/action => generated 0 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:56.080870 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-70fd9823-1e0f-4a83-a5f4-58a556b8bf57 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:56.081227 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-dce8bfb0-5ec6-4461-b01f-39963600c0c5 req-29a3a538-8256-4d7b-8a0a-ba6bedb93d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546f23a4-a39c-4249-8865-0e4fdb2059e8", "tag": "0df8d7f9-7a57-41a6-a60d-c88e0c7cac22"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:56.082923 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70fd9823-1e0f-4a83-a5f4-58a556b8bf57 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:25:56.095501 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70fd9823-1e0f-4a83-a5f4-58a556b8bf57 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:56.097196 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70fd9823-1e0f-4a83-a5f4-58a556b8bf57 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:56.098214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70fd9823-1e0f-4a83-a5f4-58a556b8bf57 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:56.098659 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70fd9823-1e0f-4a83-a5f4-58a556b8bf57 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:56.104382 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-dce8bfb0-5ec6-4461-b01f-39963600c0c5 req-29a3a538-8256-4d7b-8a0a-ba6bedb93d7e service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:25:56.104843 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-dce8bfb0-5ec6-4461-b01f-39963600c0c5 req-29a3a538-8256-4d7b-8a0a-ba6bedb93d7e service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:25:56.131756 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-dce8bfb0-5ec6-4461-b01f-39963600c0c5 req-29a3a538-8256-4d7b-8a0a-ba6bedb93d7e service nova] Creating event network-changed:0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 for instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 on hv-cinder-85124 Jul 28 09:25:56.145389 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-dce8bfb0-5ec6-4461-b01f-39963600c0c5 req-29a3a538-8256-4d7b-8a0a-ba6bedb93d7e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068218 Jul 28 09:25:56.146026 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 558/1139] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:56.527303 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-70fd9823-1e0f-4a83-a5f4-58a556b8bf57 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:56.539314 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-70fd9823-1e0f-4a83-a5f4-58a556b8bf57 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1759 microversion: 2.1 time: 0.462225 Jul 28 09:25:56.539908 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 582/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:25:56 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1759 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:10.955335 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:10.956087 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:10.960185 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-2be869ab-05e2-44cd-b8b1-519d2a5ff870 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:10.960775 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2be869ab-05e2-44cd-b8b1-519d2a5ff870 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:10.969576 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2be869ab-05e2-44cd-b8b1-519d2a5ff870 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:10.970042 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2be869ab-05e2-44cd-b8b1-519d2a5ff870 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:10.970816 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2be869ab-05e2-44cd-b8b1-519d2a5ff870 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:10.971255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-2be869ab-05e2-44cd-b8b1-519d2a5ff870 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:11.000786 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-2be869ab-05e2-44cd-b8b1-519d2a5ff870 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:26:11.081917 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-2be869ab-05e2-44cd-b8b1-519d2a5ff870 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 204 len: 0 microversion: 2.1 time: 0.127846 Jul 28 09:26:11.082489 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 559/1141] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:26:10 2022] DELETE /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:26:11.090909 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-05c7fdb0-0ef0-4436-9efa-6fafb06e3d95 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:11.091520 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-05c7fdb0-0ef0-4436-9efa-6fafb06e3d95 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:11.094074 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:11.094721 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=25 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:11.100369 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05c7fdb0-0ef0-4436-9efa-6fafb06e3d95 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:11.100819 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05c7fdb0-0ef0-4436-9efa-6fafb06e3d95 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:11.101578 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05c7fdb0-0ef0-4436-9efa-6fafb06e3d95 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:11.102049 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-05c7fdb0-0ef0-4436-9efa-6fafb06e3d95 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:11.234877 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-05c7fdb0-0ef0-4436-9efa-6fafb06e3d95 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:11.242316 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-05c7fdb0-0ef0-4436-9efa-6fafb06e3d95 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1574 microversion: 2.1 time: 0.155472 Jul 28 09:26:11.242883 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 583/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:11 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:12.270241 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-20a9fcb9-9215-43ee-b0a9-4a4ef5a26a2b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:12.270938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-20a9fcb9-9215-43ee-b0a9-4a4ef5a26a2b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:12.277448 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-20a9fcb9-9215-43ee-b0a9-4a4ef5a26a2b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:12.277947 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-20a9fcb9-9215-43ee-b0a9-4a4ef5a26a2b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:12.278998 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-20a9fcb9-9215-43ee-b0a9-4a4ef5a26a2b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:12.279529 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-20a9fcb9-9215-43ee-b0a9-4a4ef5a26a2b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:12.416847 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-20a9fcb9-9215-43ee-b0a9-4a4ef5a26a2b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:12.424376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-20a9fcb9-9215-43ee-b0a9-4a4ef5a26a2b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1574 microversion: 2.1 time: 0.158355 Jul 28 09:26:12.424937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 560/1143] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:12 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:13.445948 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9a1d9a34-e50e-4582-8bd3-49c4497fab2e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:13.446539 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9a1d9a34-e50e-4582-8bd3-49c4497fab2e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:13.453031 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a1d9a34-e50e-4582-8bd3-49c4497fab2e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:13.453488 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a1d9a34-e50e-4582-8bd3-49c4497fab2e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:13.454307 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a1d9a34-e50e-4582-8bd3-49c4497fab2e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:13.454745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a1d9a34-e50e-4582-8bd3-49c4497fab2e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:13.534113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9a1d9a34-e50e-4582-8bd3-49c4497fab2e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:13.542145 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9a1d9a34-e50e-4582-8bd3-49c4497fab2e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 200 len: 1507 microversion: 2.1 time: 0.100085 Jul 28 09:26:13.542728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 584/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:13 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 1507 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:13.710510 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-1f2c8842-3aab-4bae-a8d9-48ee879fd908 req-5b5715a3-4850-46de-802f-0cd8c2aaac29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c938b286-4c8f-4695-b0fc-942f9c573cb9", "name": "network-vif-deleted", "tag": "576868e7-d820-4531-a560-9a02eb21a924"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:13.723223 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-1f2c8842-3aab-4bae-a8d9-48ee879fd908 req-5b5715a3-4850-46de-802f-0cd8c2aaac29 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:13.723672 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-1f2c8842-3aab-4bae-a8d9-48ee879fd908 req-5b5715a3-4850-46de-802f-0cd8c2aaac29 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:13.736230 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-1f2c8842-3aab-4bae-a8d9-48ee879fd908 req-5b5715a3-4850-46de-802f-0cd8c2aaac29 service nova] Creating event network-vif-deleted:576868e7-d820-4531-a560-9a02eb21a924 for instance c938b286-4c8f-4695-b0fc-942f9c573cb9 on hv-cinder-85124 Jul 28 09:26:13.741566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-1f2c8842-3aab-4bae-a8d9-48ee879fd908 req-5b5715a3-4850-46de-802f-0cd8c2aaac29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034702 Jul 28 09:26:13.742555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 561/1145] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:14.563153 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:14.563758 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:14.570371 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:14.570822 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:14.571579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:14.572514 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:14.587456 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] HTTP exception thrown: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Request method failure captured: Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 HTTP/1.1 Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lVQn6JPBt278ssF1bSnCpmDQ4PW91BczVhj04c-UqDv0g02XNx5DzSBYG0cIRAs1_oUbQbPJdouoQQPTBRY4wIhiVBzs-ZV_TyYz0E-SNn2mmLK8djXwBEhdyY9GYUHAtMIIiT3G-oFaj68p1bL8xSqJ9PWjzdSH6lrZ4pRhKgu3vk Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:26:14.590113 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b688d320376c4492b3ca97b95c5207a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}] Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: f56d3e6849ff4268a03ef67c8cf0f813 Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:26:14.591848 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'c938b286-4c8f-4695-b0fc-942f9c573cb9'} Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:26:14.592853 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:26:14.594336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:26:14.595707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Returning 404 to user: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:26:14.595707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e78562a4-3133-40ae-8542-b9977ce8c455 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 404 len: 111 microversion: 2.1 time: 0.032458 Jul 28 09:26:14.595707 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 585/1146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:14 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:26:14.695619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-512443967", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-105365110", "security_groups": [{"name": "tempest-secgroup-smoke-362222153"}], "block_device_mapping_v2": [{"uuid": "8f699dbc-cf26-4607-b420-ab070946f362", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d35f2c27-9c9b-43b1-b077-ba21c954e931"}]}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:14.816439 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.network.neutron [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] validate_networks() for [('d35f2c27-9c9b-43b1-b077-ba21c954e931', None, None, None, None, None)] {{(pid=117863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:26:15.200841 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Flavor limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:26:15.201260 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Image limits 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:26:15.201733 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Flavor pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:26:15.202164 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Image pref 0:0:0 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:26:15.202569 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.virt.hardware [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:26:15.211348 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:15.211785 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:15.212897 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:15.213331 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:15.230547 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Getting quotas for project b688d320376c4492b3ca97b95c5207a5. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:26:15.234436 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.quota [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Getting quotas for user f56d3e6849ff4268a03ef67c8cf0f813 and project b688d320376c4492b3ca97b95c5207a5. Resources: {'cores', 'ram', 'instances'} {{(pid=117863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:26:15.291467 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Going to run 1 instances... {{(pid=117863) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:26:15.293605 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f699dbc-cf26-4607-b420-ab070946f362',volume_size=None,volume_type=None)] {{(pid=117863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:26:15.420992 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ef4e7284-9aba-4315-bb30-a0ed5b005b40 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.729529 Jul 28 09:26:15.421641 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 562/1147] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:26:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:26:15.435933 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d49c5a74-f4cc-4ce2-8ca1-cbcbd5717c83 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:15.436555 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d49c5a74-f4cc-4ce2-8ca1-cbcbd5717c83 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:15.494837 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d49c5a74-f4cc-4ce2-8ca1-cbcbd5717c83 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:15.506032 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d49c5a74-f4cc-4ce2-8ca1-cbcbd5717c83 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1093 microversion: 2.1 time: 0.077045 Jul 28 09:26:15.507004 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 586/1148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:15 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:16.527580 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-14f21fb8-b3d2-41c0-8d92-93b3214d9521 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:16.528189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-14f21fb8-b3d2-41c0-8d92-93b3214d9521 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:16.535282 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-14f21fb8-b3d2-41c0-8d92-93b3214d9521 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:16.535732 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-14f21fb8-b3d2-41c0-8d92-93b3214d9521 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:16.536491 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-14f21fb8-b3d2-41c0-8d92-93b3214d9521 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:16.536923 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-14f21fb8-b3d2-41c0-8d92-93b3214d9521 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:16.615246 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-14f21fb8-b3d2-41c0-8d92-93b3214d9521 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:16.623184 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-14f21fb8-b3d2-41c0-8d92-93b3214d9521 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1209 microversion: 2.1 time: 0.100096 Jul 28 09:26:16.624071 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 563/1149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:16 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:17.648052 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-049a3c59-375a-43ed-aa2c-83844adea150 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:17.648661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-049a3c59-375a-43ed-aa2c-83844adea150 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:17.656506 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-049a3c59-375a-43ed-aa2c-83844adea150 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:17.656958 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-049a3c59-375a-43ed-aa2c-83844adea150 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:17.657912 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-049a3c59-375a-43ed-aa2c-83844adea150 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:17.658351 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-049a3c59-375a-43ed-aa2c-83844adea150 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:18.059573 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-049a3c59-375a-43ed-aa2c-83844adea150 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:18.067008 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-049a3c59-375a-43ed-aa2c-83844adea150 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.423714 Jul 28 09:26:18.067575 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 587/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:17 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:18.148844 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-6eab289f-2510-4937-8188-e9026af32b33 req-0c3131b6-94ce-41a5-b567-dc22d74b18ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377d2c28-58ce-4dfa-9751-13d0326ac3e9", "tag": "b7a1926b-dfc7-4cfb-8e45-5810ce515872"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:18.162004 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-6eab289f-2510-4937-8188-e9026af32b33 req-0c3131b6-94ce-41a5-b567-dc22d74b18ce service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:18.162600 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-6eab289f-2510-4937-8188-e9026af32b33 req-0c3131b6-94ce-41a5-b567-dc22d74b18ce service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:18.180158 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-6eab289f-2510-4937-8188-e9026af32b33 req-0c3131b6-94ce-41a5-b567-dc22d74b18ce service nova] Creating event network-changed:b7a1926b-dfc7-4cfb-8e45-5810ce515872 for instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 on hv-cinder-85124 Jul 28 09:26:18.185978 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-6eab289f-2510-4937-8188-e9026af32b33 req-0c3131b6-94ce-41a5-b567-dc22d74b18ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042316 Jul 28 09:26:18.186717 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 564/1151] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:26:19.089329 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-eb3c7b81-cbca-45e6-ae81-ebf20b317e9d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:19.089956 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-eb3c7b81-cbca-45e6-ae81-ebf20b317e9d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:19.096473 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eb3c7b81-cbca-45e6-ae81-ebf20b317e9d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:19.096918 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eb3c7b81-cbca-45e6-ae81-ebf20b317e9d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:19.097682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eb3c7b81-cbca-45e6-ae81-ebf20b317e9d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:19.098148 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-eb3c7b81-cbca-45e6-ae81-ebf20b317e9d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:19.407834 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-eb3c7b81-cbca-45e6-ae81-ebf20b317e9d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:19.415637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-eb3c7b81-cbca-45e6-ae81-ebf20b317e9d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.330894 Jul 28 09:26:19.416335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 588/1152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:19 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:20.437860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-b8eedf4a-16fb-49c0-9415-43eee57ed741 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:20.438621 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-b8eedf4a-16fb-49c0-9415-43eee57ed741 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:20.449809 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b8eedf4a-16fb-49c0-9415-43eee57ed741 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:20.450297 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b8eedf4a-16fb-49c0-9415-43eee57ed741 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:20.451070 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b8eedf4a-16fb-49c0-9415-43eee57ed741 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:20.451507 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-b8eedf4a-16fb-49c0-9415-43eee57ed741 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:20.585077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-b8eedf4a-16fb-49c0-9415-43eee57ed741 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:20.593408 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-b8eedf4a-16fb-49c0-9415-43eee57ed741 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.160499 Jul 28 09:26:20.593990 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 565/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:20 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:21.613952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-49e6e822-a57c-4655-a443-d95f233bd93e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:21.614580 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-49e6e822-a57c-4655-a443-d95f233bd93e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:21.621640 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-49e6e822-a57c-4655-a443-d95f233bd93e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:21.622145 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-49e6e822-a57c-4655-a443-d95f233bd93e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:21.622908 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-49e6e822-a57c-4655-a443-d95f233bd93e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:21.623346 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-49e6e822-a57c-4655-a443-d95f233bd93e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:21.758222 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-49e6e822-a57c-4655-a443-d95f233bd93e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:21.765814 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-49e6e822-a57c-4655-a443-d95f233bd93e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.155683 Jul 28 09:26:21.766406 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 589/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:21 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:22.787161 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6b0c00ec-bd21-4320-a16b-2c12de99f1e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:22.787905 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6b0c00ec-bd21-4320-a16b-2c12de99f1e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:22.795097 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6b0c00ec-bd21-4320-a16b-2c12de99f1e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:22.795548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6b0c00ec-bd21-4320-a16b-2c12de99f1e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:22.796339 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6b0c00ec-bd21-4320-a16b-2c12de99f1e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:22.796777 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6b0c00ec-bd21-4320-a16b-2c12de99f1e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:22.981993 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6b0c00ec-bd21-4320-a16b-2c12de99f1e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:22.989354 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6b0c00ec-bd21-4320-a16b-2c12de99f1e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.206074 Jul 28 09:26:22.989920 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 566/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:22 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:24.011540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-193e6d52-5725-403c-920d-3b10d2f02126 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:24.012152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-193e6d52-5725-403c-920d-3b10d2f02126 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:24.018639 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-193e6d52-5725-403c-920d-3b10d2f02126 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:24.019084 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-193e6d52-5725-403c-920d-3b10d2f02126 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:24.019834 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-193e6d52-5725-403c-920d-3b10d2f02126 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:24.020267 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-193e6d52-5725-403c-920d-3b10d2f02126 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:24.149475 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-193e6d52-5725-403c-920d-3b10d2f02126 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:24.157477 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-193e6d52-5725-403c-920d-3b10d2f02126 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.150559 Jul 28 09:26:24.158054 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 590/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:24 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:25.177494 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e8942594-a250-480c-a8ee-1c80f3007860 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:25.178133 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e8942594-a250-480c-a8ee-1c80f3007860 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:25.185101 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e8942594-a250-480c-a8ee-1c80f3007860 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:25.185554 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e8942594-a250-480c-a8ee-1c80f3007860 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:25.186362 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e8942594-a250-480c-a8ee-1c80f3007860 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:25.186798 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e8942594-a250-480c-a8ee-1c80f3007860 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:25.220478 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:25.240391 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=6 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:25.327038 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-e8942594-a250-480c-a8ee-1c80f3007860 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:25.334420 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e8942594-a250-480c-a8ee-1c80f3007860 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.160961 Jul 28 09:26:25.334976 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 567/1157] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:25 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:26.357493 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9a544c8e-7e8f-4314-b3bd-92bcca72ec98 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:26.358120 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9a544c8e-7e8f-4314-b3bd-92bcca72ec98 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:26.360356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:26.365767 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a544c8e-7e8f-4314-b3bd-92bcca72ec98 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:26.366235 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a544c8e-7e8f-4314-b3bd-92bcca72ec98 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:26.366993 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a544c8e-7e8f-4314-b3bd-92bcca72ec98 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:26.367423 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9a544c8e-7e8f-4314-b3bd-92bcca72ec98 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:26.495601 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-9a544c8e-7e8f-4314-b3bd-92bcca72ec98 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:26.503001 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9a544c8e-7e8f-4314-b3bd-92bcca72ec98 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.150345 Jul 28 09:26:26.503567 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 591/1158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:26 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:27.523255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1c1f9ac3-85a6-4948-837c-357db68c126e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:27.523848 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1c1f9ac3-85a6-4948-837c-357db68c126e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:27.530907 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c1f9ac3-85a6-4948-837c-357db68c126e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:27.531353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c1f9ac3-85a6-4948-837c-357db68c126e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:27.532117 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c1f9ac3-85a6-4948-837c-357db68c126e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:27.532554 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1c1f9ac3-85a6-4948-837c-357db68c126e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:27.663732 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1c1f9ac3-85a6-4948-837c-357db68c126e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:27.671774 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1c1f9ac3-85a6-4948-837c-357db68c126e tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.152476 Jul 28 09:26:27.672332 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 568/1159] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:27 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:28.692385 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a50bf123-d565-4b4e-b1c0-9c2b9af504ce tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:28.692997 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a50bf123-d565-4b4e-b1c0-9c2b9af504ce tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:28.699516 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a50bf123-d565-4b4e-b1c0-9c2b9af504ce tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:28.699971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a50bf123-d565-4b4e-b1c0-9c2b9af504ce tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:28.700729 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a50bf123-d565-4b4e-b1c0-9c2b9af504ce tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:28.701166 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a50bf123-d565-4b4e-b1c0-9c2b9af504ce tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:28.829806 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a50bf123-d565-4b4e-b1c0-9c2b9af504ce tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:28.837286 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a50bf123-d565-4b4e-b1c0-9c2b9af504ce tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.148726 Jul 28 09:26:28.838128 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 592/1160] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:28 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:29.430109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-860f4356-1fcb-4ed9-8dd2-f3d43eca3db6 req-e76e0cff-38e7-4c25-a174-50edd1576d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377d2c28-58ce-4dfa-9751-13d0326ac3e9", "name": "network-vif-plugged", "status": "completed", "tag": "b7a1926b-dfc7-4cfb-8e45-5810ce515872"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:29.440586 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-860f4356-1fcb-4ed9-8dd2-f3d43eca3db6 req-e76e0cff-38e7-4c25-a174-50edd1576d83 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:29.441221 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-860f4356-1fcb-4ed9-8dd2-f3d43eca3db6 req-e76e0cff-38e7-4c25-a174-50edd1576d83 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:29.457244 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-860f4356-1fcb-4ed9-8dd2-f3d43eca3db6 req-e76e0cff-38e7-4c25-a174-50edd1576d83 service nova] Creating event network-vif-plugged:b7a1926b-dfc7-4cfb-8e45-5810ce515872 for instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 on hv-cinder-85124 Jul 28 09:26:29.462707 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-860f4356-1fcb-4ed9-8dd2-f3d43eca3db6 req-e76e0cff-38e7-4c25-a174-50edd1576d83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036842 Jul 28 09:26:29.464189 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 569/1161] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:29.858628 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-03294267-1171-4e5d-a8d3-8fb57f760261 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:29.859234 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-03294267-1171-4e5d-a8d3-8fb57f760261 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:29.865718 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-03294267-1171-4e5d-a8d3-8fb57f760261 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:29.866190 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-03294267-1171-4e5d-a8d3-8fb57f760261 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:29.866944 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-03294267-1171-4e5d-a8d3-8fb57f760261 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:29.867375 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-03294267-1171-4e5d-a8d3-8fb57f760261 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:30.001030 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-03294267-1171-4e5d-a8d3-8fb57f760261 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:30.009177 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-03294267-1171-4e5d-a8d3-8fb57f760261 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.154596 Jul 28 09:26:30.010306 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 593/1162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:29 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:31.031627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-4780d2cf-74fe-4f1e-8ff5-02158e0eb81b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:31.032318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-4780d2cf-74fe-4f1e-8ff5-02158e0eb81b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:31.039107 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4780d2cf-74fe-4f1e-8ff5-02158e0eb81b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:31.039557 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4780d2cf-74fe-4f1e-8ff5-02158e0eb81b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:31.040307 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4780d2cf-74fe-4f1e-8ff5-02158e0eb81b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:31.040738 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-4780d2cf-74fe-4f1e-8ff5-02158e0eb81b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:31.176336 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-4780d2cf-74fe-4f1e-8ff5-02158e0eb81b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:31.184260 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-4780d2cf-74fe-4f1e-8ff5-02158e0eb81b tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1264 microversion: 2.1 time: 0.156816 Jul 28 09:26:31.184824 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 570/1163] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:31 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:32.205902 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-afc58dec-d4a9-4fc1-9281-ee803512cf8d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:32.206591 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-afc58dec-d4a9-4fc1-9281-ee803512cf8d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:32.213318 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc58dec-d4a9-4fc1-9281-ee803512cf8d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:32.213786 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc58dec-d4a9-4fc1-9281-ee803512cf8d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:32.214563 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc58dec-d4a9-4fc1-9281-ee803512cf8d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:32.215000 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc58dec-d4a9-4fc1-9281-ee803512cf8d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:32.349472 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-afc58dec-d4a9-4fc1-9281-ee803512cf8d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:32.357757 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-afc58dec-d4a9-4fc1-9281-ee803512cf8d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1450 microversion: 2.1 time: 0.155766 Jul 28 09:26:32.358362 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 594/1164] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:32 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:32.378277 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-a2b29445-8e3e-4170-b48e-e775e6fa5851 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:32.378889 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-a2b29445-8e3e-4170-b48e-e775e6fa5851 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:32.385327 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a2b29445-8e3e-4170-b48e-e775e6fa5851 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:32.385768 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a2b29445-8e3e-4170-b48e-e775e6fa5851 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:32.386555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a2b29445-8e3e-4170-b48e-e775e6fa5851 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:32.386988 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-a2b29445-8e3e-4170-b48e-e775e6fa5851 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:32.519493 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-a2b29445-8e3e-4170-b48e-e775e6fa5851 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:32.530855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-a2b29445-8e3e-4170-b48e-e775e6fa5851 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1450 microversion: 2.1 time: 0.156017 Jul 28 09:26:32.531685 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 571/1165] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:32 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:34.498760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-8f3c48a9-0c11-40dc-91b7-cebea60dd86c req-838a1af2-b446-4780-8c1f-a7a80202ee03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377d2c28-58ce-4dfa-9751-13d0326ac3e9", "tag": "b7a1926b-dfc7-4cfb-8e45-5810ce515872"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:34.509411 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8f3c48a9-0c11-40dc-91b7-cebea60dd86c req-838a1af2-b446-4780-8c1f-a7a80202ee03 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:34.510505 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8f3c48a9-0c11-40dc-91b7-cebea60dd86c req-838a1af2-b446-4780-8c1f-a7a80202ee03 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:34.523685 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-8f3c48a9-0c11-40dc-91b7-cebea60dd86c req-838a1af2-b446-4780-8c1f-a7a80202ee03 service nova] Creating event network-changed:b7a1926b-dfc7-4cfb-8e45-5810ce515872 for instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 on hv-cinder-85124 Jul 28 09:26:34.529411 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-8f3c48a9-0c11-40dc-91b7-cebea60dd86c req-838a1af2-b446-4780-8c1f-a7a80202ee03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035028 Jul 28 09:26:34.530576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 595/1166] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:54.229353 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-41b699f0-f66b-4ad4-b76d-1d9f1cbfb490 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:54.231603 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-41b699f0-f66b-4ad4-b76d-1d9f1cbfb490 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:54.234427 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:54.235346 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:54.240938 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41b699f0-f66b-4ad4-b76d-1d9f1cbfb490 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:54.241449 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41b699f0-f66b-4ad4-b76d-1d9f1cbfb490 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:54.242249 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41b699f0-f66b-4ad4-b76d-1d9f1cbfb490 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:54.242761 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-41b699f0-f66b-4ad4-b76d-1d9f1cbfb490 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:54.322722 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-41b699f0-f66b-4ad4-b76d-1d9f1cbfb490 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "POST /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/action" status: 202 len: 0 microversion: 2.1 time: 0.097175 Jul 28 09:26:54.323366 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 572/1167] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:26:54 2022] POST /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:54.330623 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=28 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:54.331416 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=64 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:26:54.336678 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-27ae840a-5cf5-4783-9f65-3b4777b481d6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:54.337449 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-27ae840a-5cf5-4783-9f65-3b4777b481d6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:54.348540 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-27ae840a-5cf5-4783-9f65-3b4777b481d6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:54.349592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-27ae840a-5cf5-4783-9f65-3b4777b481d6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:54.350043 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-27ae840a-5cf5-4783-9f65-3b4777b481d6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:54.350568 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-27ae840a-5cf5-4783-9f65-3b4777b481d6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:54.578388 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-27ae840a-5cf5-4783-9f65-3b4777b481d6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:54.586792 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-27ae840a-5cf5-4783-9f65-3b4777b481d6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1751 microversion: 2.1 time: 0.258241 Jul 28 09:26:54.587631 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 596/1168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:54 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1751 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:55.610325 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-03377f27-14a3-4620-bc6b-a5d6ae6bc05e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:55.611016 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-03377f27-14a3-4620-bc6b-a5d6ae6bc05e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:55.617259 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-03377f27-14a3-4620-bc6b-a5d6ae6bc05e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:55.617700 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-03377f27-14a3-4620-bc6b-a5d6ae6bc05e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:55.618498 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-03377f27-14a3-4620-bc6b-a5d6ae6bc05e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:55.618926 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-03377f27-14a3-4620-bc6b-a5d6ae6bc05e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:55.765609 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-03377f27-14a3-4620-bc6b-a5d6ae6bc05e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:55.773551 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-03377f27-14a3-4620-bc6b-a5d6ae6bc05e tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.168559 Jul 28 09:26:55.774141 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 573/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:55 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:56.795854 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-68eb7ccc-7d7c-485a-b279-1afc12e9522b tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:56.796984 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-68eb7ccc-7d7c-485a-b279-1afc12e9522b tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:56.803241 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-68eb7ccc-7d7c-485a-b279-1afc12e9522b tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:56.803692 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-68eb7ccc-7d7c-485a-b279-1afc12e9522b tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:56.804454 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-68eb7ccc-7d7c-485a-b279-1afc12e9522b tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:56.804893 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-68eb7ccc-7d7c-485a-b279-1afc12e9522b tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:56.947723 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-68eb7ccc-7d7c-485a-b279-1afc12e9522b tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:56.956226 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-68eb7ccc-7d7c-485a-b279-1afc12e9522b tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.164805 Jul 28 09:26:56.956791 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 597/1170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:56 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:57.978320 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ca24c65e-2b4c-4b3d-b73e-89e72ccc1649 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:57.978951 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ca24c65e-2b4c-4b3d-b73e-89e72ccc1649 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:57.985813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca24c65e-2b4c-4b3d-b73e-89e72ccc1649 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:57.986289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca24c65e-2b4c-4b3d-b73e-89e72ccc1649 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:57.987050 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca24c65e-2b4c-4b3d-b73e-89e72ccc1649 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:57.987476 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ca24c65e-2b4c-4b3d-b73e-89e72ccc1649 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:58.132380 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ca24c65e-2b4c-4b3d-b73e-89e72ccc1649 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:58.140293 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ca24c65e-2b4c-4b3d-b73e-89e72ccc1649 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.165812 Jul 28 09:26:58.140855 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 574/1171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:57 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:59.162633 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-506d73db-e6ed-449b-835f-cee38432cdcc tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:59.163273 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-506d73db-e6ed-449b-835f-cee38432cdcc tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:26:59.169715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-506d73db-e6ed-449b-835f-cee38432cdcc tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:59.170745 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-506d73db-e6ed-449b-835f-cee38432cdcc tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:59.171497 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-506d73db-e6ed-449b-835f-cee38432cdcc tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:26:59.171938 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-506d73db-e6ed-449b-835f-cee38432cdcc tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:26:59.312451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-506d73db-e6ed-449b-835f-cee38432cdcc tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:59.320443 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-506d73db-e6ed-449b-835f-cee38432cdcc tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.161640 Jul 28 09:26:59.320999 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 598/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:26:59 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:00.342779 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-ba592eb0-c6e8-4d36-92a0-e0ee30030d01 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:00.343422 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-ba592eb0-c6e8-4d36-92a0-e0ee30030d01 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:27:00.350051 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ba592eb0-c6e8-4d36-92a0-e0ee30030d01 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:00.350501 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ba592eb0-c6e8-4d36-92a0-e0ee30030d01 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:00.351255 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ba592eb0-c6e8-4d36-92a0-e0ee30030d01 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:00.351693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-ba592eb0-c6e8-4d36-92a0-e0ee30030d01 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:00.499797 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-ba592eb0-c6e8-4d36-92a0-e0ee30030d01 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:00.507745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-ba592eb0-c6e8-4d36-92a0-e0ee30030d01 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.169638 Jul 28 09:27:00.508307 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 575/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:27:00 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:01.528766 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c713438-dab1-4b24-91b5-7dbbc5ffd561 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:01.529393 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c713438-dab1-4b24-91b5-7dbbc5ffd561 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:27:01.537053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c713438-dab1-4b24-91b5-7dbbc5ffd561 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:01.537512 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c713438-dab1-4b24-91b5-7dbbc5ffd561 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:01.538310 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c713438-dab1-4b24-91b5-7dbbc5ffd561 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:01.538747 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c713438-dab1-4b24-91b5-7dbbc5ffd561 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:01.675765 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c713438-dab1-4b24-91b5-7dbbc5ffd561 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:01.683636 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c713438-dab1-4b24-91b5-7dbbc5ffd561 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.158766 Jul 28 09:27:01.684201 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 599/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:27:01 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:02.712504 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c2c78ad8-cbb5-49a6-9aec-5c0fd0002dc8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:02.713127 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-c2c78ad8-cbb5-49a6-9aec-5c0fd0002dc8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:27:02.721318 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c2c78ad8-cbb5-49a6-9aec-5c0fd0002dc8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:02.721984 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c2c78ad8-cbb5-49a6-9aec-5c0fd0002dc8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:02.722758 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c2c78ad8-cbb5-49a6-9aec-5c0fd0002dc8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:02.723207 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-c2c78ad8-cbb5-49a6-9aec-5c0fd0002dc8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:02.864773 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-c2c78ad8-cbb5-49a6-9aec-5c0fd0002dc8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:02.872617 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c2c78ad8-cbb5-49a6-9aec-5c0fd0002dc8 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.164041 Jul 28 09:27:02.873190 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 576/1175] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:27:02 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:03.893831 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-50d7e908-7f2e-4b1b-9b04-d9fa4da53d64 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:03.894461 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-50d7e908-7f2e-4b1b-9b04-d9fa4da53d64 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:27:03.900917 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50d7e908-7f2e-4b1b-9b04-d9fa4da53d64 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:03.901362 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50d7e908-7f2e-4b1b-9b04-d9fa4da53d64 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:03.902152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50d7e908-7f2e-4b1b-9b04-d9fa4da53d64 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:03.902592 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-50d7e908-7f2e-4b1b-9b04-d9fa4da53d64 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:04.046306 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-50d7e908-7f2e-4b1b-9b04-d9fa4da53d64 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:04.054190 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-50d7e908-7f2e-4b1b-9b04-d9fa4da53d64 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.164180 Jul 28 09:27:04.054759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 600/1176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:27:03 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:05.076866 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-8b589a56-e62c-4fa7-a7ce-dc6048047514 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:05.077464 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-8b589a56-e62c-4fa7-a7ce-dc6048047514 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:27:05.085791 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8b589a56-e62c-4fa7-a7ce-dc6048047514 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:05.086488 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8b589a56-e62c-4fa7-a7ce-dc6048047514 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:05.087264 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8b589a56-e62c-4fa7-a7ce-dc6048047514 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:05.087700 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-8b589a56-e62c-4fa7-a7ce-dc6048047514 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:05.232169 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-8b589a56-e62c-4fa7-a7ce-dc6048047514 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:05.240253 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-8b589a56-e62c-4fa7-a7ce-dc6048047514 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.168954 Jul 28 09:27:05.240821 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 577/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:27:05 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:06.261438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d43ace2a-9357-4b14-9bdb-68837eaf199d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:06.262127 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d43ace2a-9357-4b14-9bdb-68837eaf199d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:27:06.269216 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d43ace2a-9357-4b14-9bdb-68837eaf199d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:06.269661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d43ace2a-9357-4b14-9bdb-68837eaf199d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:06.270543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d43ace2a-9357-4b14-9bdb-68837eaf199d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:06.270983 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d43ace2a-9357-4b14-9bdb-68837eaf199d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:06.439277 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d43ace2a-9357-4b14-9bdb-68837eaf199d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:06.447524 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d43ace2a-9357-4b14-9bdb-68837eaf199d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1756 microversion: 2.1 time: 0.189996 Jul 28 09:27:06.448296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 601/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:27:06 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:07.468669 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-af753596-c6bb-4354-b83a-b5ff6200400f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:07.469281 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-af753596-c6bb-4354-b83a-b5ff6200400f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:27:07.475749 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-af753596-c6bb-4354-b83a-b5ff6200400f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:07.476200 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-af753596-c6bb-4354-b83a-b5ff6200400f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:07.476959 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-af753596-c6bb-4354-b83a-b5ff6200400f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:27:07.477394 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-af753596-c6bb-4354-b83a-b5ff6200400f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:27:07.619387 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-af753596-c6bb-4354-b83a-b5ff6200400f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:07.627435 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-af753596-c6bb-4354-b83a-b5ff6200400f tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1759 microversion: 2.1 time: 0.163270 Jul 28 09:27:07.628005 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 578/1179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:27:07 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:11.043952 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=12 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:11.044851 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=36 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:11.049269 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-371c9754-866a-4331-9aed-3878ffc4f6ba tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1911187866"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:11.049791 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-371c9754-866a-4331-9aed-3878ffc4f6ba tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:11.056589 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-371c9754-866a-4331-9aed-3878ffc4f6ba tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:11.057032 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-371c9754-866a-4331-9aed-3878ffc4f6ba tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:11.057793 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-371c9754-866a-4331-9aed-3878ffc4f6ba tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:11.058251 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-371c9754-866a-4331-9aed-3878ffc4f6ba tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:11.187535 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.network.security_group_api [None req-371c9754-866a-4331-9aed-3878ffc4f6ba tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Removing security group 6a14a700-f970-4c42-bef4-cb741bd28c99 from port 0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 Jul 28 09:28:11.530577 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-371c9754-866a-4331-9aed-3878ffc4f6ba tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "POST /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/action" status: 202 len: 0 microversion: 2.1 time: 0.488347 Jul 28 09:28:11.532794 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 602/1180] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 09:28:11 2022] POST /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:28:11.543561 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=14 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:11.544500 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:11.548655 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-358d56ea-8b93-4205-a928-6743c2193e8a req-460b9828-5aae-4b26-875e-05775123b048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546f23a4-a39c-4249-8865-0e4fdb2059e8", "tag": "0df8d7f9-7a57-41a6-a60d-c88e0c7cac22"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:11.561117 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-358d56ea-8b93-4205-a928-6743c2193e8a req-460b9828-5aae-4b26-875e-05775123b048 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:11.561940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-358d56ea-8b93-4205-a928-6743c2193e8a req-460b9828-5aae-4b26-875e-05775123b048 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:11.577975 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-358d56ea-8b93-4205-a928-6743c2193e8a req-460b9828-5aae-4b26-875e-05775123b048 service nova] Creating event network-changed:0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 for instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 on hv-cinder-85124 Jul 28 09:28:11.585250 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-358d56ea-8b93-4205-a928-6743c2193e8a req-460b9828-5aae-4b26-875e-05775123b048 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044499 Jul 28 09:28:11.586748 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 579/1181] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:28:13.140490 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-058b7d8d-11aa-40ea-b7a3-0835617d1482 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:13.141073 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-058b7d8d-11aa-40ea-b7a3-0835617d1482 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:13.147813 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-058b7d8d-11aa-40ea-b7a3-0835617d1482 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:13.148254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-058b7d8d-11aa-40ea-b7a3-0835617d1482 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:13.149021 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-058b7d8d-11aa-40ea-b7a3-0835617d1482 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:13.149451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-058b7d8d-11aa-40ea-b7a3-0835617d1482 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:13.237226 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-058b7d8d-11aa-40ea-b7a3-0835617d1482 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lazy-loading 'services' on Instance uuid 546f23a4-a39c-4249-8865-0e4fdb2059e8 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 09:28:13.313797 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-058b7d8d-11aa-40ea-b7a3-0835617d1482 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "DELETE /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments/73e79990-8f41-43d2-80d6-3f5e0976ea93" status: 202 len: 0 microversion: 2.1 time: 0.177756 Jul 28 09:28:13.314452 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 603/1182] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:28:13 2022] DELETE /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments/73e79990-8f41-43d2-80d6-3f5e0976ea93 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:28:13.325555 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-7e21436b-edfb-4c24-8d6e-fac056aedf2d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:13.328095 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-7e21436b-edfb-4c24-8d6e-fac056aedf2d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:13.338431 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7e21436b-edfb-4c24-8d6e-fac056aedf2d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:13.338946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7e21436b-edfb-4c24-8d6e-fac056aedf2d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:13.340156 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7e21436b-edfb-4c24-8d6e-fac056aedf2d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:13.340863 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-7e21436b-edfb-4c24-8d6e-fac056aedf2d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:13.382923 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-7e21436b-edfb-4c24-8d6e-fac056aedf2d tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062297 Jul 28 09:28:13.383739 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 580/1183] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:28:13 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:28:13.609090 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-8480541c-205e-4d41-9a19-2188c0ac3d44 req-b7dfc267-f011-48d4-94df-256deb244ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546f23a4-a39c-4249-8865-0e4fdb2059e8", "tag": "0df8d7f9-7a57-41a6-a60d-c88e0c7cac22"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:13.619968 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8480541c-205e-4d41-9a19-2188c0ac3d44 req-b7dfc267-f011-48d4-94df-256deb244ae2 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:13.620413 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8480541c-205e-4d41-9a19-2188c0ac3d44 req-b7dfc267-f011-48d4-94df-256deb244ae2 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:13.632096 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-8480541c-205e-4d41-9a19-2188c0ac3d44 req-b7dfc267-f011-48d4-94df-256deb244ae2 service nova] Creating event network-changed:0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 for instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 on hv-cinder-85124 Jul 28 09:28:13.637331 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-8480541c-205e-4d41-9a19-2188c0ac3d44 req-b7dfc267-f011-48d4-94df-256deb244ae2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032217 Jul 28 09:28:13.637930 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 604/1184] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:28:14.396502 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-0192d48a-6bd8-4a3b-9424-2045095e9cd9 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:14.398751 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-0192d48a-6bd8-4a3b-9424-2045095e9cd9 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:14.405416 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0192d48a-6bd8-4a3b-9424-2045095e9cd9 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:14.405885 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0192d48a-6bd8-4a3b-9424-2045095e9cd9 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:14.407260 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0192d48a-6bd8-4a3b-9424-2045095e9cd9 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:14.407769 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-0192d48a-6bd8-4a3b-9424-2045095e9cd9 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:14.444322 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-0192d48a-6bd8-4a3b-9424-2045095e9cd9 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052613 Jul 28 09:28:14.444914 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 581/1185] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 09:28:14 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:28:14.455698 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:14.456913 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:14.463596 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:14.464045 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:14.465074 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:14.465503 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:14.540381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] HTTP exception thrown: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 is not attached to volume 73e79990-8f41-43d2-80d6-3f5e0976ea93 Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Request method failure captured: Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments/73e79990-8f41-43d2-80d6-3f5e0976ea93 HTTP/1.1 Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lXsN9n9NpTn8NJ_sLpL2oaSSqxUexw5rP6RgxFHsHzXJra5l2E8rWQVsnPO3QvPNOIIGzOjlZbbv_o73GGceQ0TRB7rdookkLGPahh6vBQgjsaCcAepTaE4IpJKRFoqBdSeWRFpIfJFmuyjte_wbP0SyTtj6RoPnXMkMCPE_Otkz2I Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 33b2e26d27c84e738eede31dc3c9ee3a Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-TestMinimumBasicScenario-1489752951 Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:28:14.542748 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/33b2e26d27c84e738eede31dc3c9ee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/33b2e26d27c84e738eede31dc3c9ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_33b2e26d27c84e738eede31dc3c9ee3a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/33b2e26d27c84e738eede31dc3c9ee3a"}]}] Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-TestMinimumBasicScenario-1489752951 Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 33b2e26d27c84e738eede31dc3c9ee3a Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1489752951 Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-TestMinimumBasicScenario-1489752951-project Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: cafc77c67a844f248b0879d39d5511dd Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-TestMinimumBasicScenario-1489752951-project Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:28:14.544526 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 is not attached to volume 73e79990-8f41-43d2-80d6-3f5e0976ea93 Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'server_id': '546f23a4-a39c-4249-8865-0e4fdb2059e8', 'id': '73e79990-8f41-43d2-80d6-3f5e0976ea93'} Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 73e79990-8f41-43d2-80d6-3f5e0976ea93. Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:28:14.545507 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 is not attached to volume 73e79990-8f41-43d2-80d6-3f5e0976ea93 Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 is not attached to volume 73e79990-8f41-43d2-80d6-3f5e0976ea93 Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:14.547350 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Returning 404 to user: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 is not attached to volume 73e79990-8f41-43d2-80d6-3f5e0976ea93 {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:28:14.548588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0d3a69f3-3695-4feb-b019-6c6865bc9c30 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "DELETE /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments/73e79990-8f41-43d2-80d6-3f5e0976ea93" status: 404 len: 154 microversion: 2.1 time: 0.092824 Jul 28 09:28:14.548588 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 605/1186] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 09:28:14 2022] DELETE /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8/os-volume_attachments/73e79990-8f41-43d2-80d6-3f5e0976ea93 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:28:15.684629 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-e60eb48b-6d92-47f8-87c0-0a1fd2b98566 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:15.685159 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e60eb48b-6d92-47f8-87c0-0a1fd2b98566 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:15.692425 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e60eb48b-6d92-47f8-87c0-0a1fd2b98566 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:15.692870 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e60eb48b-6d92-47f8-87c0-0a1fd2b98566 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:15.693626 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e60eb48b-6d92-47f8-87c0-0a1fd2b98566 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:15.694083 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-e60eb48b-6d92-47f8-87c0-0a1fd2b98566 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:15.719371 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-e60eb48b-6d92-47f8-87c0-0a1fd2b98566 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Going to try to terminate instance {{(pid=117863) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:28:15.797410 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-e60eb48b-6d92-47f8-87c0-0a1fd2b98566 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "DELETE /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 204 len: 0 microversion: 2.1 time: 0.116276 Jul 28 09:28:15.798040 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 582/1187] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:28:15 2022] DELETE /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:28:15.807649 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e70fb049-791a-4d65-b4ac-004a9551e277 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:15.808335 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e70fb049-791a-4d65-b4ac-004a9551e277 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:15.814336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e70fb049-791a-4d65-b4ac-004a9551e277 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:15.814865 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e70fb049-791a-4d65-b4ac-004a9551e277 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:15.815543 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e70fb049-791a-4d65-b4ac-004a9551e277 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:15.815972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e70fb049-791a-4d65-b4ac-004a9551e277 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:15.962072 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-e70fb049-791a-4d65-b4ac-004a9551e277 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:15.970406 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e70fb049-791a-4d65-b4ac-004a9551e277 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1554 microversion: 2.1 time: 0.166878 Jul 28 09:28:15.970972 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 606/1188] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:15 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:16.991946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-841f94be-2a08-4f01-9a38-fccf0f9779d7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:16.992754 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-841f94be-2a08-4f01-9a38-fccf0f9779d7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:16.999283 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-841f94be-2a08-4f01-9a38-fccf0f9779d7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:16.999731 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-841f94be-2a08-4f01-9a38-fccf0f9779d7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:17.000496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-841f94be-2a08-4f01-9a38-fccf0f9779d7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:17.000932 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-841f94be-2a08-4f01-9a38-fccf0f9779d7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:17.040668 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:28:17.041305 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Thu Jul 28 09:28:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:28:17.140603 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-841f94be-2a08-4f01-9a38-fccf0f9779d7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:17.148250 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-841f94be-2a08-4f01-9a38-fccf0f9779d7 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1554 microversion: 2.1 time: 0.160516 Jul 28 09:28:17.148818 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 583/1189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:16 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:18.172887 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6bff22f3-b1b6-4757-add5-e6f845bf1722 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:18.173753 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6bff22f3-b1b6-4757-add5-e6f845bf1722 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:18.188053 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6bff22f3-b1b6-4757-add5-e6f845bf1722 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:18.188537 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6bff22f3-b1b6-4757-add5-e6f845bf1722 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:18.189322 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6bff22f3-b1b6-4757-add5-e6f845bf1722 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:18.189815 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6bff22f3-b1b6-4757-add5-e6f845bf1722 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:18.282252 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6bff22f3-b1b6-4757-add5-e6f845bf1722 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc77c67a844f248b0879d39d5511dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b2e26d27c84e738eede31dc3c9ee3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:18.290905 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6bff22f3-b1b6-4757-add5-e6f845bf1722 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 200 len: 1512 microversion: 2.1 time: 0.125130 Jul 28 09:28:18.291489 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 607/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:18 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 1512 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:18.304883 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-cc53c0a2-f376-4fb7-bcf9-5bb97106b1eb req-37b10172-a113-4b9d-9aab-009e81e84ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546f23a4-a39c-4249-8865-0e4fdb2059e8", "name": "network-vif-deleted", "tag": "0df8d7f9-7a57-41a6-a60d-c88e0c7cac22"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:18.317179 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-cc53c0a2-f376-4fb7-bcf9-5bb97106b1eb req-37b10172-a113-4b9d-9aab-009e81e84ac8 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:18.317583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-cc53c0a2-f376-4fb7-bcf9-5bb97106b1eb req-37b10172-a113-4b9d-9aab-009e81e84ac8 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:18.330109 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-cc53c0a2-f376-4fb7-bcf9-5bb97106b1eb req-37b10172-a113-4b9d-9aab-009e81e84ac8 service nova] Creating event network-vif-deleted:0df8d7f9-7a57-41a6-a60d-c88e0c7cac22 for instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 on hv-cinder-85124 Jul 28 09:28:18.337264 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-cc53c0a2-f376-4fb7-bcf9-5bb97106b1eb req-37b10172-a113-4b9d-9aab-009e81e84ac8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118259 Jul 28 09:28:18.338520 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 584/1191] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:28:19.312014 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:19.312884 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] [instance: 546f23a4-a39c-4249-8865-0e4fdb2059e8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:19.320152 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:19.320594 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:19.321368 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:19.321803 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:19.335784 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] HTTP exception thrown: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 could not be found. Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Request method failure captured: Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 HTTP/1.1 Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lXsN9n9NpTn8NJ_sLpL2oaSSqxUexw5rP6RgxFHsHzXJra5l2E8rWQVsnPO3QvPNOIIGzOjlZbbv_o73GGceQ0TRB7rdookkLGPahh6vBQgjsaCcAepTaE4IpJKRFoqBdSeWRFpIfJFmuyjte_wbP0SyTtj6RoPnXMkMCPE_Otkz2I Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: 33b2e26d27c84e738eede31dc3c9ee3a Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-TestMinimumBasicScenario-1489752951 Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:28:19.337332 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/33b2e26d27c84e738eede31dc3c9ee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/33b2e26d27c84e738eede31dc3c9ee3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_33b2e26d27c84e738eede31dc3c9ee3a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/33b2e26d27c84e738eede31dc3c9ee3a"}]}] Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-TestMinimumBasicScenario-1489752951 Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: 33b2e26d27c84e738eede31dc3c9ee3a Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1489752951 Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-TestMinimumBasicScenario-1489752951-project Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: cafc77c67a844f248b0879d39d5511dd Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-TestMinimumBasicScenario-1489752951-project Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 could not be found. Jul 28 09:28:19.339323 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': '546f23a4-a39c-4249-8865-0e4fdb2059e8'} Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 could not be found. Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:28:19.340579 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 could not be found. Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 could not be found. Jul 28 09:28:19.342263 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:28:19.343914 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Returning 404 to user: Instance 546f23a4-a39c-4249-8865-0e4fdb2059e8 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:28:19.343914 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-735527c4-3ee9-4a3f-a6d6-a86d14fe4860 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8" status: 404 len: 111 microversion: 2.1 time: 0.030602 Jul 28 09:28:19.343914 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 608/1192] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:19 2022] GET /compute/v2.1/servers/546f23a4-a39c-4249-8865-0e4fdb2059e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:28:19.350421 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-c07197e8-ecfd-4ebf-9229-9a416328c2e6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] Calling method '.version_select at 0x7fd6bf7e38b0>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:19.371445 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-c07197e8-ecfd-4ebf-9229-9a416328c2e6 tempest-TestMinimumBasicScenario-1489752951 tempest-TestMinimumBasicScenario-1489752951-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1524824059" status: 202 len: 0 microversion: 2.1 time: 0.026773 Jul 28 09:28:19.372029 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 585/1193] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 09:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1524824059 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:28:46.940214 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-992443796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-105365110", "security_groups": [{"name": "tempest-secgroup-smoke-362222153"}], "block_device_mapping_v2": [{"uuid": "db80c6a7-d7e9-4610-a083-7bc47850f485", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d35f2c27-9c9b-43b1-b077-ba21c954e931"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:46.949661 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=14 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:46.950336 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:47.053782 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] validate_networks() for [('d35f2c27-9c9b-43b1-b077-ba21c954e931', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 09:28:47.515760 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:28:47.516189 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:28:47.516669 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:28:47.517111 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:28:47.517525 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:28:47.526351 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:47.526799 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:47.527602 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:47.528043 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:47.544467 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Getting quotas for project b688d320376c4492b3ca97b95c5207a5. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 09:28:47.548401 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.quota [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Getting quotas for user f56d3e6849ff4268a03ef67c8cf0f813 and project b688d320376c4492b3ca97b95c5207a5. Resources: {'cores', 'ram', 'instances'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 09:28:47.604354 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 09:28:47.606451 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db80c6a7-d7e9-4610-a083-7bc47850f485',volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 09:28:47.741773 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3ca1c100-500c-4f30-a91c-1af3a1bc40b5 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805417 Jul 28 09:28:47.742356 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 609/1194] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 09:28:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:28:47.750846 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:47.751585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:47.755940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1f342829-a215-4748-a6ac-318ca88db13f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:47.756637 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1f342829-a215-4748-a6ac-318ca88db13f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:47.816543 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1f342829-a215-4748-a6ac-318ca88db13f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:47.823215 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1f342829-a215-4748-a6ac-318ca88db13f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1093 microversion: 2.1 time: 0.073900 Jul 28 09:28:47.823774 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 586/1195] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:47 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:48.844475 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5b57d148-dc5c-4157-902c-f1ee94a145d4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:48.845117 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5b57d148-dc5c-4157-902c-f1ee94a145d4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:48.851362 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5b57d148-dc5c-4157-902c-f1ee94a145d4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:48.851814 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5b57d148-dc5c-4157-902c-f1ee94a145d4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:48.852598 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5b57d148-dc5c-4157-902c-f1ee94a145d4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:48.853031 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5b57d148-dc5c-4157-902c-f1ee94a145d4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:48.924092 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-5b57d148-dc5c-4157-902c-f1ee94a145d4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:48.932194 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5b57d148-dc5c-4157-902c-f1ee94a145d4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1199 microversion: 2.1 time: 0.092315 Jul 28 09:28:48.932978 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 610/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:48 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:49.954497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-cd8218c5-e638-4491-a46e-bbfe57f1ba94 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:49.955116 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-cd8218c5-e638-4491-a46e-bbfe57f1ba94 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:49.961693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cd8218c5-e638-4491-a46e-bbfe57f1ba94 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:49.962177 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cd8218c5-e638-4491-a46e-bbfe57f1ba94 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:49.962940 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cd8218c5-e638-4491-a46e-bbfe57f1ba94 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:49.963376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-cd8218c5-e638-4491-a46e-bbfe57f1ba94 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:50.186342 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-cd8218c5-e638-4491-a46e-bbfe57f1ba94 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:50.195102 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-cd8218c5-e638-4491-a46e-bbfe57f1ba94 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.244388 Jul 28 09:28:50.195719 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 587/1197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:49 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:50.332087 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-7657e3d4-ef32-4a1a-9c8c-35f5b45663d2 req-757912ee-b25c-4f60-93f0-4aa0e96bf9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce38d6a-eff5-4d1a-b307-394d15351169", "tag": "cde8144e-35fc-491a-b4bc-1e8fff9538d4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:50.343537 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-7657e3d4-ef32-4a1a-9c8c-35f5b45663d2 req-757912ee-b25c-4f60-93f0-4aa0e96bf9c1 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:50.344191 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-7657e3d4-ef32-4a1a-9c8c-35f5b45663d2 req-757912ee-b25c-4f60-93f0-4aa0e96bf9c1 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:50.355985 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-7657e3d4-ef32-4a1a-9c8c-35f5b45663d2 req-757912ee-b25c-4f60-93f0-4aa0e96bf9c1 service nova] Creating event network-changed:cde8144e-35fc-491a-b4bc-1e8fff9538d4 for instance cce38d6a-eff5-4d1a-b307-394d15351169 on hv-cinder-85124 Jul 28 09:28:50.360896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-7657e3d4-ef32-4a1a-9c8c-35f5b45663d2 req-757912ee-b25c-4f60-93f0-4aa0e96bf9c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033866 Jul 28 09:28:50.361495 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 611/1198] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:28:51.217041 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-052f10a8-b4fd-4916-87ce-2ac17485b17a tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:51.217649 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-052f10a8-b4fd-4916-87ce-2ac17485b17a tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:51.224173 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-052f10a8-b4fd-4916-87ce-2ac17485b17a tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:51.224626 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-052f10a8-b4fd-4916-87ce-2ac17485b17a tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:51.226049 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-052f10a8-b4fd-4916-87ce-2ac17485b17a tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:51.226496 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-052f10a8-b4fd-4916-87ce-2ac17485b17a tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:51.608583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-052f10a8-b4fd-4916-87ce-2ac17485b17a tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:51.616161 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-052f10a8-b4fd-4916-87ce-2ac17485b17a tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.403189 Jul 28 09:28:51.616721 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 588/1199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:51 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:52.641304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3a960327-39c8-4f52-991e-dfe2c592cc81 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:52.642293 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3a960327-39c8-4f52-991e-dfe2c592cc81 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:52.652438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3a960327-39c8-4f52-991e-dfe2c592cc81 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:52.652438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3a960327-39c8-4f52-991e-dfe2c592cc81 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:52.652438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3a960327-39c8-4f52-991e-dfe2c592cc81 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:52.652438 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3a960327-39c8-4f52-991e-dfe2c592cc81 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:52.785793 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-3a960327-39c8-4f52-991e-dfe2c592cc81 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:52.794724 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3a960327-39c8-4f52-991e-dfe2c592cc81 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.158346 Jul 28 09:28:52.795304 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 612/1200] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:52 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:53.815326 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-26933414-27af-4e02-a3bb-893129260ad9 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:53.815930 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-26933414-27af-4e02-a3bb-893129260ad9 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:53.822414 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-26933414-27af-4e02-a3bb-893129260ad9 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:53.822872 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-26933414-27af-4e02-a3bb-893129260ad9 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:53.823636 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-26933414-27af-4e02-a3bb-893129260ad9 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:53.824077 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-26933414-27af-4e02-a3bb-893129260ad9 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:53.956960 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-26933414-27af-4e02-a3bb-893129260ad9 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:53.964340 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-26933414-27af-4e02-a3bb-893129260ad9 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.152861 Jul 28 09:28:53.964905 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 589/1201] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:53 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:54.986123 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6421709a-87d8-4ba1-80c2-3aeba128e54d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:54.986675 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6421709a-87d8-4ba1-80c2-3aeba128e54d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:54.993002 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6421709a-87d8-4ba1-80c2-3aeba128e54d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:54.993444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6421709a-87d8-4ba1-80c2-3aeba128e54d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:54.994217 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6421709a-87d8-4ba1-80c2-3aeba128e54d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:54.994648 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6421709a-87d8-4ba1-80c2-3aeba128e54d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:55.123238 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6421709a-87d8-4ba1-80c2-3aeba128e54d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:55.130580 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6421709a-87d8-4ba1-80c2-3aeba128e54d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.148652 Jul 28 09:28:55.131140 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 613/1202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:54 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:56.150442 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-1e199bc6-23cf-4330-83b1-690648d4a7d7 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:56.151031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-1e199bc6-23cf-4330-83b1-690648d4a7d7 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:56.157585 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1e199bc6-23cf-4330-83b1-690648d4a7d7 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:56.158072 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1e199bc6-23cf-4330-83b1-690648d4a7d7 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:56.158834 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1e199bc6-23cf-4330-83b1-690648d4a7d7 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:56.159289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-1e199bc6-23cf-4330-83b1-690648d4a7d7 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:56.296715 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-1e199bc6-23cf-4330-83b1-690648d4a7d7 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:56.306185 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-1e199bc6-23cf-4330-83b1-690648d4a7d7 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.159411 Jul 28 09:28:56.307238 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 590/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:56 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:57.330068 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-30769115-6a2b-479a-839a-8cb3e4cfedda tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:57.330717 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-30769115-6a2b-479a-839a-8cb3e4cfedda tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:57.337553 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30769115-6a2b-479a-839a-8cb3e4cfedda tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:57.338024 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30769115-6a2b-479a-839a-8cb3e4cfedda tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:57.338782 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30769115-6a2b-479a-839a-8cb3e4cfedda tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:57.339219 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30769115-6a2b-479a-839a-8cb3e4cfedda tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:57.467303 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-30769115-6a2b-479a-839a-8cb3e4cfedda tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:57.474841 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-30769115-6a2b-479a-839a-8cb3e4cfedda tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.148656 Jul 28 09:28:57.475407 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 614/1204] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:57 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:58.496713 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-6e344ae4-0296-4e3f-90c7-2e7efa9c56b8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:58.497285 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-6e344ae4-0296-4e3f-90c7-2e7efa9c56b8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:58.499799 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell0:SELECT=2 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:58.505324 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e344ae4-0296-4e3f-90c7-2e7efa9c56b8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:58.505769 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e344ae4-0296-4e3f-90c7-2e7efa9c56b8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:58.506548 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e344ae4-0296-4e3f-90c7-2e7efa9c56b8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:58.506979 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-6e344ae4-0296-4e3f-90c7-2e7efa9c56b8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:58.636645 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-6e344ae4-0296-4e3f-90c7-2e7efa9c56b8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:58.644138 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-6e344ae4-0296-4e3f-90c7-2e7efa9c56b8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.152020 Jul 28 09:28:58.644695 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 591/1205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:58 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:59.665083 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b1c6a3ce-602b-4301-b2c4-00c6030c269d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:59.665597 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b1c6a3ce-602b-4301-b2c4-00c6030c269d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:28:59.667594 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:59.668243 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:28:59.674446 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c6a3ce-602b-4301-b2c4-00c6030c269d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:59.674896 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c6a3ce-602b-4301-b2c4-00c6030c269d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:59.675680 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c6a3ce-602b-4301-b2c4-00c6030c269d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:28:59.676114 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c6a3ce-602b-4301-b2c4-00c6030c269d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:28:59.807296 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b1c6a3ce-602b-4301-b2c4-00c6030c269d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:59.814650 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b1c6a3ce-602b-4301-b2c4-00c6030c269d tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.154013 Jul 28 09:28:59.815210 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 615/1206] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:28:59 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:00.835516 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f74096cc-19b5-463c-9f75-24fee7ea1340 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:00.836671 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f74096cc-19b5-463c-9f75-24fee7ea1340 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:29:00.843566 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f74096cc-19b5-463c-9f75-24fee7ea1340 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:00.844022 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f74096cc-19b5-463c-9f75-24fee7ea1340 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:00.844937 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f74096cc-19b5-463c-9f75-24fee7ea1340 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:00.845380 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f74096cc-19b5-463c-9f75-24fee7ea1340 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:00.976058 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f74096cc-19b5-463c-9f75-24fee7ea1340 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:00.984229 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f74096cc-19b5-463c-9f75-24fee7ea1340 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.152513 Jul 28 09:29:00.984798 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 592/1207] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:29:00 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:02.004637 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-42be4c4e-ccf4-4ac0-a0ac-d5037692c346 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:02.005254 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-42be4c4e-ccf4-4ac0-a0ac-d5037692c346 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:29:02.012060 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-42be4c4e-ccf4-4ac0-a0ac-d5037692c346 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:02.012511 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-42be4c4e-ccf4-4ac0-a0ac-d5037692c346 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:02.013284 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-42be4c4e-ccf4-4ac0-a0ac-d5037692c346 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:02.013728 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-42be4c4e-ccf4-4ac0-a0ac-d5037692c346 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:02.161309 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-42be4c4e-ccf4-4ac0-a0ac-d5037692c346 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:02.169425 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-42be4c4e-ccf4-4ac0-a0ac-d5037692c346 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.168646 Jul 28 09:29:02.170034 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 616/1208] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:29:01 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:02.341379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-f3abd989-526e-43c3-a522-20057fa886d0 req-9200cede-3525-439b-82d9-2e9ba95dd598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce38d6a-eff5-4d1a-b307-394d15351169", "name": "network-vif-plugged", "status": "completed", "tag": "cde8144e-35fc-491a-b4bc-1e8fff9538d4"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:02.350779 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-f3abd989-526e-43c3-a522-20057fa886d0 req-9200cede-3525-439b-82d9-2e9ba95dd598 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:02.351219 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-f3abd989-526e-43c3-a522-20057fa886d0 req-9200cede-3525-439b-82d9-2e9ba95dd598 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:02.363303 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-f3abd989-526e-43c3-a522-20057fa886d0 req-9200cede-3525-439b-82d9-2e9ba95dd598 service nova] Creating event network-vif-plugged:cde8144e-35fc-491a-b4bc-1e8fff9538d4 for instance cce38d6a-eff5-4d1a-b307-394d15351169 on hv-cinder-85124 Jul 28 09:29:02.368778 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-f3abd989-526e-43c3-a522-20057fa886d0 req-9200cede-3525-439b-82d9-2e9ba95dd598 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160126 Jul 28 09:29:02.369379 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 593/1209] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:03.191411 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6d321115-eb95-473c-bdf1-47198e6776c1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:03.191986 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6d321115-eb95-473c-bdf1-47198e6776c1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:29:03.199061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6d321115-eb95-473c-bdf1-47198e6776c1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:03.199511 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6d321115-eb95-473c-bdf1-47198e6776c1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:03.200276 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6d321115-eb95-473c-bdf1-47198e6776c1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:03.200714 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6d321115-eb95-473c-bdf1-47198e6776c1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:03.327499 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-6d321115-eb95-473c-bdf1-47198e6776c1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:03.335701 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6d321115-eb95-473c-bdf1-47198e6776c1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1264 microversion: 2.1 time: 0.148202 Jul 28 09:29:03.336265 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 617/1210] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:29:03 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:04.357662 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-12ff642a-ddf8-4edc-883c-9338834c83be tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:04.358376 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-12ff642a-ddf8-4edc-883c-9338834c83be tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:29:04.364720 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12ff642a-ddf8-4edc-883c-9338834c83be tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:04.365165 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12ff642a-ddf8-4edc-883c-9338834c83be tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:04.365942 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12ff642a-ddf8-4edc-883c-9338834c83be tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:04.366375 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-12ff642a-ddf8-4edc-883c-9338834c83be tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:04.500162 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-12ff642a-ddf8-4edc-883c-9338834c83be tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:04.507719 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-12ff642a-ddf8-4edc-883c-9338834c83be tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1450 microversion: 2.1 time: 0.154290 Jul 28 09:29:04.508794 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 594/1211] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:29:04 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:04.528496 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a4191990-fdc0-4b71-a79e-c2889b2888e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:04.529109 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a4191990-fdc0-4b71-a79e-c2889b2888e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:29:04.535632 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4191990-fdc0-4b71-a79e-c2889b2888e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:04.536082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4191990-fdc0-4b71-a79e-c2889b2888e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:04.536845 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4191990-fdc0-4b71-a79e-c2889b2888e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:04.537289 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4191990-fdc0-4b71-a79e-c2889b2888e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:04.663881 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-a4191990-fdc0-4b71-a79e-c2889b2888e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:04.671303 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a4191990-fdc0-4b71-a79e-c2889b2888e1 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1450 microversion: 2.1 time: 0.147233 Jul 28 09:29:04.671860 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 618/1212] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:29:04 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:06.359857 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-06b3bb09-ede8-4bfd-b5af-7b74ca66cac3 req-756f0e02-4961-4dfa-b77b-d0197220264a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce38d6a-eff5-4d1a-b307-394d15351169", "tag": "cde8144e-35fc-491a-b4bc-1e8fff9538d4"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:06.370880 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-06b3bb09-ede8-4bfd-b5af-7b74ca66cac3 req-756f0e02-4961-4dfa-b77b-d0197220264a service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:29:06.371745 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-06b3bb09-ede8-4bfd-b5af-7b74ca66cac3 req-756f0e02-4961-4dfa-b77b-d0197220264a service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:29:06.387054 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-06b3bb09-ede8-4bfd-b5af-7b74ca66cac3 req-756f0e02-4961-4dfa-b77b-d0197220264a service nova] Creating event network-changed:cde8144e-35fc-491a-b4bc-1e8fff9538d4 for instance cce38d6a-eff5-4d1a-b307-394d15351169 on hv-cinder-85124 Jul 28 09:29:06.392238 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-06b3bb09-ede8-4bfd-b5af-7b74ca66cac3 req-756f0e02-4961-4dfa-b77b-d0197220264a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036264 Jul 28 09:29:06.393171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 595/1213] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:56.093799 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [738bba78-ef77-41a1-812e-b6c103671018] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 09:30:56.094603 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_api:SELECT=22 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:30:56.094715 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-30d5b2dc-9b5d-4ae2-81fb-762b6dee0ba8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:56.095623 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG dbcounter [-] [117863] Writing DB stats nova_cell1:SELECT=46 {{(pid=117863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:30:56.095759 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-30d5b2dc-9b5d-4ae2-81fb-762b6dee0ba8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:30:56.098674 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d85a1e9b-c68e-4c84-b2a7-a1b3b7f0dd80] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 09:30:56.099314 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:30:56.100007 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=52 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:30:56.100134 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-1b20e6e5-92fb-4812-a035-2bf56ab90ef9 req-975d787a-3d4b-4fa7-b32d-0e4c4ee5ccc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce38d6a-eff5-4d1a-b307-394d15351169", "tag": "cde8144e-35fc-491a-b4bc-1e8fff9538d4"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:56.106761 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30d5b2dc-9b5d-4ae2-81fb-762b6dee0ba8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:56.107220 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30d5b2dc-9b5d-4ae2-81fb-762b6dee0ba8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:56.108002 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30d5b2dc-9b5d-4ae2-81fb-762b6dee0ba8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:56.108445 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30d5b2dc-9b5d-4ae2-81fb-762b6dee0ba8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:56.110458 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-1b20e6e5-92fb-4812-a035-2bf56ab90ef9 req-975d787a-3d4b-4fa7-b32d-0e4c4ee5ccc6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:56.111281 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-1b20e6e5-92fb-4812-a035-2bf56ab90ef9 req-975d787a-3d4b-4fa7-b32d-0e4c4ee5ccc6 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:56.124863 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-1b20e6e5-92fb-4812-a035-2bf56ab90ef9 req-975d787a-3d4b-4fa7-b32d-0e4c4ee5ccc6 service nova] Creating event network-changed:cde8144e-35fc-491a-b4bc-1e8fff9538d4 for instance cce38d6a-eff5-4d1a-b307-394d15351169 on hv-cinder-85124 Jul 28 09:30:56.128792 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-1b20e6e5-92fb-4812-a035-2bf56ab90ef9 req-975d787a-3d4b-4fa7-b32d-0e4c4ee5ccc6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036654 Jul 28 09:30:56.129583 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 596/1214] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:30:56.136061 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-30d5b2dc-9b5d-4ae2-81fb-762b6dee0ba8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:30:56.225450 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-30d5b2dc-9b5d-4ae2-81fb-762b6dee0ba8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 204 len: 0 microversion: 2.1 time: 0.135480 Jul 28 09:30:56.229338 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 619/1215] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:30:56 2022] DELETE /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:30:56.235087 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-d29614c8-70e8-4403-8285-985dd12a1111 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:56.235789 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-d29614c8-70e8-4403-8285-985dd12a1111 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:30:56.242666 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d29614c8-70e8-4403-8285-985dd12a1111 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:56.243117 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d29614c8-70e8-4403-8285-985dd12a1111 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:56.243873 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d29614c8-70e8-4403-8285-985dd12a1111 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:56.244308 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-d29614c8-70e8-4403-8285-985dd12a1111 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:56.638723 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-d29614c8-70e8-4403-8285-985dd12a1111 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:56.647176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-d29614c8-70e8-4403-8285-985dd12a1111 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1574 microversion: 2.1 time: 0.416178 Jul 28 09:30:56.647847 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 597/1216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:30:56 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1574 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:57.669558 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c7a23773-1ca8-41a3-ade7-4ff4a9b19ace tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:57.670218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c7a23773-1ca8-41a3-ade7-4ff4a9b19ace tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:30:57.679251 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c7a23773-1ca8-41a3-ade7-4ff4a9b19ace tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:57.679709 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c7a23773-1ca8-41a3-ade7-4ff4a9b19ace tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:57.680530 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c7a23773-1ca8-41a3-ade7-4ff4a9b19ace tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:57.680971 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c7a23773-1ca8-41a3-ade7-4ff4a9b19ace tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:57.691309 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] [d85a1e9b-c68e-4c84-b2a7-a1b3b7f0dd80] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45596. Jul 28 09:30:57.826624 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-c7a23773-1ca8-41a3-ade7-4ff4a9b19ace tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:57.834796 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c7a23773-1ca8-41a3-ade7-4ff4a9b19ace tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1574 microversion: 2.1 time: 0.169644 Jul 28 09:30:57.835384 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 620/1217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:30:57 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:58.620828 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-a7b11d3f-4aa8-456d-bded-e00e80802c18 req-185671be-3b83-4637-9e2b-2f528773d827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce38d6a-eff5-4d1a-b307-394d15351169", "name": "network-vif-deleted", "tag": "cde8144e-35fc-491a-b4bc-1e8fff9538d4"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:58.633086 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-a7b11d3f-4aa8-456d-bded-e00e80802c18 req-185671be-3b83-4637-9e2b-2f528773d827 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:58.633536 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-a7b11d3f-4aa8-456d-bded-e00e80802c18 req-185671be-3b83-4637-9e2b-2f528773d827 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:58.643784 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO oslo.messaging._drivers.impl_rabbit [-] [738bba78-ef77-41a1-812e-b6c103671018] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45602. Jul 28 09:30:58.646150 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-a7b11d3f-4aa8-456d-bded-e00e80802c18 req-185671be-3b83-4637-9e2b-2f528773d827 service nova] Creating event network-vif-deleted:cde8144e-35fc-491a-b4bc-1e8fff9538d4 for instance cce38d6a-eff5-4d1a-b307-394d15351169 on hv-cinder-85124 Jul 28 09:30:58.651351 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-a7b11d3f-4aa8-456d-bded-e00e80802c18 req-185671be-3b83-4637-9e2b-2f528773d827 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034078 Jul 28 09:30:58.651986 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 598/1218] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:58.858764 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d94bca94-a584-4259-8181-259bf01fe92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:58.859399 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d94bca94-a584-4259-8181-259bf01fe92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:30:58.866562 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d94bca94-a584-4259-8181-259bf01fe92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:58.867010 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d94bca94-a584-4259-8181-259bf01fe92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:58.867781 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d94bca94-a584-4259-8181-259bf01fe92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:58.868218 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d94bca94-a584-4259-8181-259bf01fe92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:58.940200 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-d94bca94-a584-4259-8181-259bf01fe92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:58.949349 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d94bca94-a584-4259-8181-259bf01fe92f tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 200 len: 1224 microversion: 2.1 time: 0.094399 Jul 28 09:30:58.951037 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 621/1219] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:30:58 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:59.975171 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:59.975848 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: cce38d6a-eff5-4d1a-b307-394d15351169] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:30:59.982033 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:59.982477 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:59.983226 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:30:59.983656 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:30:59.996619 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] HTTP exception thrown: Instance cce38d6a-eff5-4d1a-b307-394d15351169 could not be found. Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Request method failure captured: Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 HTTP/1.1 Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lVQn6JPBt278ssF1bSnCpmDQ4PW91BczVhj04c-UqDv0g02XNx5DzSBYG0cIRAs1_oUbQbPJdouoQQPTBRY4wIhiVBzs-ZV_TyYz0E-SNn2mmLK8djXwBEhdyY9GYUHAtMIIiT3G-oFaj68p1bL8xSqJ9PWjzdSH6lrZ4pRhKgu3vk Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:30:59.998220 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b688d320376c4492b3ca97b95c5207a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}] Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: f56d3e6849ff4268a03ef67c8cf0f813 Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance cce38d6a-eff5-4d1a-b307-394d15351169 could not be found. Jul 28 09:31:00.000039 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'cce38d6a-eff5-4d1a-b307-394d15351169'} Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce38d6a-eff5-4d1a-b307-394d15351169 could not be found. Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:31:00.001152 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce38d6a-eff5-4d1a-b307-394d15351169 could not be found. Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce38d6a-eff5-4d1a-b307-394d15351169 could not be found. Jul 28 09:31:00.003497 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:00.005125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Returning 404 to user: Instance cce38d6a-eff5-4d1a-b307-394d15351169 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:31:00.005125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f1a29e06-d873-4130-80d5-a1799ca3fffe tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169" status: 404 len: 111 microversion: 2.1 time: 0.029165 Jul 28 09:31:00.005125 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 599/1220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:30:59 2022] GET /compute/v2.1/servers/cce38d6a-eff5-4d1a-b307-394d15351169 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:03.101559 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-16245464-db06-4a40-8b50-7ccf1b8c8409 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:03.102118 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-16245464-db06-4a40-8b50-7ccf1b8c8409 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:31:03.108878 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16245464-db06-4a40-8b50-7ccf1b8c8409 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:03.109325 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16245464-db06-4a40-8b50-7ccf1b8c8409 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:03.110059 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-e7eacd02-9a89-497f-8f87-3e666051bca7 req-1574769b-c429-4cae-8696-574b9508f6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377d2c28-58ce-4dfa-9751-13d0326ac3e9", "tag": "b7a1926b-dfc7-4cfb-8e45-5810ce515872"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:03.110537 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16245464-db06-4a40-8b50-7ccf1b8c8409 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:03.111230 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16245464-db06-4a40-8b50-7ccf1b8c8409 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:03.120693 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-e7eacd02-9a89-497f-8f87-3e666051bca7 req-1574769b-c429-4cae-8696-574b9508f6b0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:03.121135 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-e7eacd02-9a89-497f-8f87-3e666051bca7 req-1574769b-c429-4cae-8696-574b9508f6b0 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:03.132669 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-e7eacd02-9a89-497f-8f87-3e666051bca7 req-1574769b-c429-4cae-8696-574b9508f6b0 service nova] Creating event network-changed:b7a1926b-dfc7-4cfb-8e45-5810ce515872 for instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 on hv-cinder-85124 Jul 28 09:31:03.137643 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-16245464-db06-4a40-8b50-7ccf1b8c8409 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 09:31:03.137860 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-e7eacd02-9a89-497f-8f87-3e666051bca7 req-1574769b-c429-4cae-8696-574b9508f6b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031360 Jul 28 09:31:03.138378 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 600/1221] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:03.229790 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-16245464-db06-4a40-8b50-7ccf1b8c8409 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "DELETE /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 204 len: 0 microversion: 2.1 time: 0.131742 Jul 28 09:31:03.231137 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 622/1222] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:31:03 2022] DELETE /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:31:03.242813 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-f44c9efa-263c-44ad-bcde-0613ea7894c4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:03.243518 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-f44c9efa-263c-44ad-bcde-0613ea7894c4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:31:03.251341 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f44c9efa-263c-44ad-bcde-0613ea7894c4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:03.251865 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f44c9efa-263c-44ad-bcde-0613ea7894c4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:03.252701 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f44c9efa-263c-44ad-bcde-0613ea7894c4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:03.253241 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-f44c9efa-263c-44ad-bcde-0613ea7894c4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:03.390419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.policy [None req-f44c9efa-263c-44ad-bcde-0613ea7894c4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117863) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:03.399289 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-f44c9efa-263c-44ad-bcde-0613ea7894c4 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1575 microversion: 2.1 time: 0.161752 Jul 28 09:31:03.399865 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 601/1223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:31:03 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:04.422444 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dc943796-d240-4a76-bc9c-aede1d625544 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:04.423318 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dc943796-d240-4a76-bc9c-aede1d625544 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:31:04.429961 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc943796-d240-4a76-bc9c-aede1d625544 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:04.430414 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc943796-d240-4a76-bc9c-aede1d625544 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:04.431187 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc943796-d240-4a76-bc9c-aede1d625544 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:04.431625 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dc943796-d240-4a76-bc9c-aede1d625544 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:04.590654 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-dc943796-d240-4a76-bc9c-aede1d625544 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:04.602743 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dc943796-d240-4a76-bc9c-aede1d625544 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1575 microversion: 2.1 time: 0.184603 Jul 28 09:31:04.603399 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 623/1224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:31:04 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:05.495783 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [req-0cdef988-4ca9-4a8c-a4be-62ed3b12a870 req-c7aae088-e6f5-44bc-90c2-b836804cfb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377d2c28-58ce-4dfa-9751-13d0326ac3e9", "name": "network-vif-deleted", "tag": "b7a1926b-dfc7-4cfb-8e45-5810ce515872"}]} {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:05.507627 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-0cdef988-4ca9-4a8c-a4be-62ed3b12a870 req-c7aae088-e6f5-44bc-90c2-b836804cfb87 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:05.508073 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [req-0cdef988-4ca9-4a8c-a4be-62ed3b12a870 req-c7aae088-e6f5-44bc-90c2-b836804cfb87 service nova] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:05.521521 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.compute.server_external_events [req-0cdef988-4ca9-4a8c-a4be-62ed3b12a870 req-c7aae088-e6f5-44bc-90c2-b836804cfb87 service nova] Creating event network-vif-deleted:b7a1926b-dfc7-4cfb-8e45-5810ce515872 for instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 on hv-cinder-85124 Jul 28 09:31:05.527506 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [req-0cdef988-4ca9-4a8c-a4be-62ed3b12a870 req-c7aae088-e6f5-44bc-90c2-b836804cfb87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035550 Jul 28 09:31:05.528104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 602/1225] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 09:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:05.624340 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b73f895d-8e0f-408a-a970-b0293e843f34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:05.624969 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b73f895d-8e0f-408a-a970-b0293e843f34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:31:05.631381 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b73f895d-8e0f-408a-a970-b0293e843f34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:05.631929 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b73f895d-8e0f-408a-a970-b0293e843f34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:05.635162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b73f895d-8e0f-408a-a970-b0293e843f34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:05.635162 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b73f895d-8e0f-408a-a970-b0293e843f34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:05.693034 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.policy [None req-b73f895d-8e0f-408a-a970-b0293e843f34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56d3e6849ff4268a03ef67c8cf0f813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b688d320376c4492b3ca97b95c5207a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:05.700621 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b73f895d-8e0f-408a-a970-b0293e843f34 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 200 len: 1224 microversion: 2.1 time: 0.080168 Jul 28 09:31:05.701324 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 624/1226] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:31:05 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:06.722334 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:06.723031 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: 377d2c28-58ce-4dfa-9751-13d0326ac3e9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:31:06.729793 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:06.730300 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:06.731056 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:06.731492 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:06.745935 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] HTTP exception thrown: Instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 could not be found. Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Request method failure captured: Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 HTTP/1.1 Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lVQn6JPBt278ssF1bSnCpmDQ4PW91BczVhj04c-UqDv0g02XNx5DzSBYG0cIRAs1_oUbQbPJdouoQQPTBRY4wIhiVBzs-ZV_TyYz0E-SNn2mmLK8djXwBEhdyY9GYUHAtMIIiT3G-oFaj68p1bL8xSqJ9PWjzdSH6lrZ4pRhKgu3vk Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:31:06.748104 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b688d320376c4492b3ca97b95c5207a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}] Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: f56d3e6849ff4268a03ef67c8cf0f813 Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 could not be found. Jul 28 09:31:06.751273 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': '377d2c28-58ce-4dfa-9751-13d0326ac3e9'} Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 could not be found. Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:31:06.754176 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 could not be found. Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 could not be found. Jul 28 09:31:06.759453 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:06.762316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Returning 404 to user: Instance 377d2c28-58ce-4dfa-9751-13d0326ac3e9 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:31:06.762316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-bde2c702-63fe-4638-8f5b-0fa67c25a667 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9" status: 404 len: 111 microversion: 2.1 time: 0.031738 Jul 28 09:31:06.762316 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 603/1227] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:31:06 2022] GET /compute/v2.1/servers/377d2c28-58ce-4dfa-9751-13d0326ac3e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:07.216064 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:07.216576 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:31:07.223421 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:07.223870 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:07.224649 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:07.225082 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:07.238749 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] HTTP exception thrown: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Request method failure captured: Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 HTTP/1.1 Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept: application/json Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Accept-Encoding: identity Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Connection: close Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Length: 0 Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Content-Type: application/json Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Host: 10.222.0.48 Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.10 Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Auth-Token: gAAAAABi4lVQn6JPBt278ssF1bSnCpmDQ4PW91BczVhj04c-UqDv0g02XNx5DzSBYG0cIRAs1_oUbQbPJdouoQQPTBRY4wIhiVBzs-ZV_TyYz0E-SNn2mmLK8djXwBEhdyY9GYUHAtMIIiT3G-oFaj68p1bL8xSqJ9PWjzdSH6lrZ4pRhKgu3vk Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Id: None Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Domain-Name: None Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Project-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Role: reader,member Jul 28 09:31:07.240428 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Roles: reader,member Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b688d320376c4492b3ca97b95c5207a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}] Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Id: f56d3e6849ff4268a03ef67c8cf0f813 Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: X-User-Name: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: method: > Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: exception: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.243129 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: action_args: {'id': 'c938b286-4c8f-4695-b0fc-942f9c573cb9'} Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:31:07.244212 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.246538 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.248910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Returning 404 to user: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:31:07.248910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3979081c-e8bd-4fe9-b1b8-ec1bba840edf tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 404 len: 111 microversion: 2.1 time: 0.029660 Jul 28 09:31:07.248910 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 625/1228] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 09:31:07 2022] DELETE /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:31:07.250694 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '>' {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:07.251310 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.compute.api [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [instance: c938b286-4c8f-4695-b0fc-942f9c573cb9] Fetching instance by UUID {{(pid=117863) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 09:31:07.258013 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:07.258463 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:07.259239 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 09:31:07.259677 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG oslo_concurrency.lockutils [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Lock "16c49c6f-9465-40a7-880f-cddb465d5406" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 09:31:07.273456 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.wsgi [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] HTTP exception thrown: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Request method failure captured: Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: request: GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 HTTP/1.1 Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept: application/json Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Accept-Encoding: identity Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Connection: close Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Length: 0 Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Content-Type: application/json Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Host: 10.222.0.48 Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Openstack-System-Scope: None Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: User-Agent: python-urllib3/1.26.10 Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Auth-Token: gAAAAABi4lVQn6JPBt278ssF1bSnCpmDQ4PW91BczVhj04c-UqDv0g02XNx5DzSBYG0cIRAs1_oUbQbPJdouoQQPTBRY4wIhiVBzs-ZV_TyYz0E-SNn2mmLK8djXwBEhdyY9GYUHAtMIIiT3G-oFaj68p1bL8xSqJ9PWjzdSH6lrZ4pRhKgu3vk Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Id: None Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Domain-Name: None Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Identity-Status: Confirmed Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Is-Admin-Project: True Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Id: default Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Domain-Name: Default Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Project-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Role: reader,member Jul 28 09:31:07.275010 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Roles: reader,member Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b688d320376c4492b3ca97b95c5207a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b688d320376c4492b3ca97b95c5207a5"}]}] Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Id: b688d320376c4492b3ca97b95c5207a5 Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888553856 Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Id: default Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Domain-Name: Default Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Id: f56d3e6849ff4268a03ef67c8cf0f813 Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: X-User-Name: tempest-TestVolumeBootPattern-1888553856-project Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: method: > Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: exception: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.276755 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: action_args: {'id': 'c938b286-4c8f-4695-b0fc-942f9c573cb9'} Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: {{(pid=117863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 09:31:07.277946 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. Jul 28 09:31:07.279419 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: ERROR nova.api.openstack.wsgi Jul 28 09:31:07.280864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: DEBUG nova.api.openstack.wsgi [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Returning 404 to user: Instance c938b286-4c8f-4695-b0fc-942f9c573cb9 could not be found. {{(pid=117863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 09:31:07.280864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO nova.api.openstack.requestlog [None req-5fb15c3a-374a-4c3a-94cd-8793eeb2dde8 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9" status: 404 len: 111 microversion: 2.1 time: 0.029530 Jul 28 09:31:07.280864 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: [pid: 117863|app: 0|req: 604/1229] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 09:31:07 2022] GET /compute/v2.1/servers/c938b286-4c8f-4695-b0fc-942f9c573cb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:08.613260 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5d50b734-acae-4eb6-853b-e0ffe7d9be69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] Calling method '.version_select at 0x7fd6be8fd940>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:08.617682 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d50b734-acae-4eb6-853b-e0ffe7d9be69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [db27635c-5973-42c3-a93b-e7e9ff33e908] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 09:31:09.626166 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d50b734-acae-4eb6-853b-e0ffe7d9be69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] [db27635c-5973-42c3-a93b-e7e9ff33e908] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 45658. Jul 28 09:31:09.649402 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5d50b734-acae-4eb6-853b-e0ffe7d9be69 tempest-TestVolumeBootPattern-1888553856 tempest-TestVolumeBootPattern-1888553856-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-105365110" status: 202 len: 0 microversion: 2.1 time: 1.040935 Jul 28 09:31:09.650022 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 626/1230] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 09:31:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-105365110 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:26.449535 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:31:26.450309 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Thu Jul 28 09:31:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:31:37.051076 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:31:37.051689 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Thu Jul 28 09:31:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:33:36.971582 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:33:36.972166 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Thu Jul 28 09:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:34:46.460033 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:34:46.460757 dv-cinder-851249-5-iscsi devstack@n-api.service[117863]: Thu Jul 28 09:34:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:34:57.060138 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:34:57.060693 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Thu Jul 28 09:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:36:28.492016 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:36:28.492919 dv-cinder-851249-5-iscsi devstack@n-api.service[117864]: Thu Jul 28 09:36:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!